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a,°:reeinfi: to join late in tne process wnen tire was critical. 



I.NTIOSJCT ION 



I . 

It rr.ay ’«ell be that ultimately, 
the field of AI will in large 
part be concerned with the 
development ' of superpowerful 
computing languages. In this 
li.?ht, the best way to measure 
AI progress is to look- at AI 
languages [3Sj . 

The sophistication of most computic? tasks in 
Artificial Intelligence (AI) can be informally measured by 
the amount of additional tire and miemory the iesi^tner claims 
necessary to perfect operation. Of course, tire is a 
constraint that will never really be eliminated - our lives 
are only so long. The memory constraint may be slightly 
relieved as more is continually packed into smaller 
packages. Consequently, as Nilsson suggests, emphasis rust 
be placed on the development of "superpowerful computing 
languages" that will, in effect take better advantage of the 
memory and time available than past or ev<=n current 
programming languages. 

The fundamental problem of any complex AI computing 
task is how to efficiently ac'^ess, search, modify, or even 
create large stores of knowledge. Thus, the development of 
more powerful languages must include the development of more 
powerful data representation and program control techniques 
than are currently available. In most cases, a refirsment of 



current techniques, such as pattern mat chine, or an 
implementation oi" a current theory, e.q., yinshy's frame 
concept, is what is needed to advance the state of the art. 
Whether this can he done hy extending the capahi 1 i t i e s of 
current AI laneuaees or hy starting from scratch to create 
entirely new ones that are based on new points of view, 
still remains to be determined. 

This thesis examines several date renresentet ion 
techniques and program control structures that have been 
developed and implemented in programming languages to 
specifically satisfy the needs of AI research, cast and 
present. The particular languages that were selected to 
demonstrate the implementations of concepts in the twc areas 
mentioned above are listed below. !^ost are popular general 
purpose AI languages that account for most of the 
programming applications to date. The last tnree are fairly 
new and still in tneir acceptance paase. 



I?L (1356 - A. New ell, K. Simon) Information Processing 

lana-uaFe. Introduced the concept of list processing. 
First implemented on a JOHNNIAC, it went throueh. 5 
iterations in development. The final version, 
was implemented on an I2W 704 by late 1353. The 
language was widely used over the next 5 or 7 years on 
a variety of macnines including an Irr 650, 709/7090, 
1620, UNIVAC 1105 and 1107, Control Data 160^ and 620, 
2urrougns 220, Fhilco 2000, and AN/FSQ-32 [4Sj . 
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COMIT (195'^ - Ya^ve) A stria? processia? laa^uat^e. 

Designed and pro^rammea at ^'IT as a joint project of 
tae Mechanical Translatioa Group of the Research 
Laboratory of Slectroaics and the Corrputatica Center. 
It was intended to provide the professional linguist 
with a pro?ramirin? system in which he could easily 
write programs needea to carry out his research. 
Development he^an on an I3M 704 and shifted to the 
709/90. An improved version, COMIT II, appeared in 196S 
on the I?M 7090/94 and was implemented on the 
System/360 by 1975 [49]. 

LISP (1959 - /.McCarthy) List Processin? language. The 
most recent and widely version of this language is LIS? 
1.5. It is a machine independent, theoretically 
oriented language designed for problems requiring list 
processing, recursive or nierarchical control, and 
symbol manipulation. It is was originally implemented 
on machines such as the IBM 1620, 709/90/9-^. DPC PDP-l , 
SDS 940, and has been implemented on a variety of 
machines since [^?] . 

L2AP (1969 - J. Feldman, P.Rovner) Language for the 
Expression of Associative Procedure's. It is based on 
ALGOL 60 and contains set theoretic and associative 
operations and data types. It has been implemented cn a 
DEC prP-10 and PDP-11, as uart of the SAIL language 
[13] . 

SAIL (1971 - D.Swinehart, B.Sproul) A heavily used 
language based on ALGOL employinf? list data structure 
and containing the set theoretic, associative 

operations and data types of LEAP. It has been 
implemented on a PDP-10 and PEP-11 [^] . 

FLANNSP. (1971 - C. Hewitt) A goal-directed language for 
proving theorems and manipulating models for a robot. 
Facilities include creation and dismissal of goals, 
provision for recommendations on which theorems to use 
in trying to draw conclusions from an assertion, and a 
powerful deductive system [49]. Th° language i'^trcduced 
the important coupled concepts of pat tern -di rec tpd 
procedure invocation and the procedural representation 
of knowledge [4] . FLANNSP nas never been fully 
implemented. A subset of the language called 
Micro-'°LANNSH nas been implemented in LIS? on a LFC 
FDP-10 at at MIT [49] . 
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CONMIVEE (1972 - G.Sussinan, E.KcEerrno tt) A lan,r’’ate 
with LlSP-lijce syrtax. Its developrent was rrotivated "by 
the desire to eliminate the defects in 'dicrc-rLJ5i\NZE 
[49j . yuch of the control wnich is automatic in FIAN'NEH 
is r^^turned to the user in COMNIVEH. The extra 
responsibility also frames this lan^'uase more difficult 
to learn. It is implemented on a EEC ?E?-12 at i-’IT [4j . 

INTEP.LIS? (1971 - W.Teitelman) Interactive LISE. As an 
extension of LISP 1.5 it adds debi.-^s'in? aids, user file 
structure, and. other features not previously available, 
such as arrays, strings, and user-definable data types 
[54j . It has teen implemented on a variety of macnines, 
primarily ESC PEP-lC's [49], 

CUSP (1973 - R.Eebch, S.Sacerdoti) Formerly the CA4 
programming language, an experimental language written 
in LIS? and implemented at the Stanford Research 
Institute around 1973. CHS? offers data types and 
pattern matching facilities that cause it tc resemble 
?IAN'NSR in philosophy and detail [49] . ?y embedding? 
CLIS? into INTERLISP additional features of fast 
execution, debugging aids, and utility f’lnctions are 
acquired. The result is the CIISP/INTEELIS ? system, one 
of the most flexible Al programming systems currently 
available. This system has been implemented on a EEC 
?E?-1C and an IBM System 360/37g [ 4 ]. 

ROPIER (1973 - J. Davies) Based on the POR-P low level 
language designed at tne University of Edin>urgn fcr 
application to AI programming. The current version of 
POPIE'^ , POOLER 1.5, provides most tne facilities of a 
PLANNER-1 ike system. It is currently implemented on a 
EEC FEP-10 at Euinburgh [4] . 

ASSET (1971 - E.Elcock, J. Pester, P.Gray, J. '-'chregor , 
A.N'urray) An interactive proc^ramming langua^-e based on 
sets developed at the Uriversity of Ab-^rdeen. Its 
invention is an attempt to pro vide a programming 
environment in which it is possible to take or aefer 
decisions about a program. logically separable 
decisions can be taken separably and in any order [15]. 
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PROLOG (1972 - A . Co Imeraue r , H.Zanovi, R.Raserc, 
?. Roussel) ? ro^^rammi ne ia Lo^ic. A PLA ‘'NRR-lilce 
language founded on symbolic logi c-computational 
mechanisms and emtodying procedural interpretation of 
deduction. Instead of functions it uses relations, 
i.e., ordered sets of clauses eacn of tne form 
patterni-dody [36]. It is a pattern matching pro'^ess 
operating on general recora structures [62j . 

T2L0S (1977 - L. Travis, y. Honda, R.LeBlanc, S.Zeigler) 
An extension of PASCAL with additional data and control 
abstraction mechanisms to suit it to AI programming 
reouirements . It does not include a list data type hut 
provides a data encapsulation mecnanism for the u'er to 
define this and a variety of other types as well [5?]. 



The next chapter examines the fundamental prcgramniing 
requirements as imposed by the nature of the research and as 
implemented in the earliest AI languages. 

Chapters Thre^ and Pour consider data representation 
and program control structures and concepts available or 

employed in current established AI lans-ua^es as well as the 

/ 

newer languages not so well established. Chapter Pive 
contains a chart summarizing the data and control featurps 
of the languages described above. 



Pol lowing 
trend of the 
nonprocedura 1 . 
distinguishing 
sys terns . 



that, Appendix A offers 
newer languages to be 
Appendix R contains the 
characteristics of 15 



a discussion of tn® 
progressively mi ore 
general designs and 
A I applications 



12 



I 



II . PACKC-POUMC 



Artificial Intelligence is the "branch of corrputer 
science devoted to programming computers to carry out tas’^^s 
that if carried cut "by human beings would require 
intelligence [23j This is a broad definition but 

indicative of the comprehensiveness of the resear-h 
dedicated to that purpose. The areas of current 

investigation include robotics, game-playing, computer 

understanding of natural language, computers as 

enow ledgeable experts in a variety of scientific fields, 
computers as commonsense problem solvers, computers as 
mechanical assistants for menial tasks, and as educational 
assistants, ^'any systems nave been aesigned to accomplish a 
variety of tasks in th®se areas (s“e Appendix r) . All ar° 
prod igious unde rt aki ngs , but few are fully developed or 
utilized outside of the laboratory “nvi ronnent in which th'=y 
were created. Generally, those that aren't experimental ar-^ 
of a special purpose nature. Each of tnese however have 
advanced the state of the art toward the goal of AI as 
identified by Graham, above, or tnat by Tcden: to use 

"computer programming to cast light on the principles of 
intelligence in general and numan tnought in particular." 
Thus, scientists are employed in either trying to discover 
now the human mind works by computer modelling of 
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information processing behavior demonstrated in 

game-play inf* , natural language understanding, and general 
problem solving, or they are interested in developing? 
systems to assist or replace humans in tasks requiring high 
visual concentration, a great deal of knowledge in a 
specific field, a large amount of physical strength, or 
complicated and time-consuming computation. 

Implementation of the systems to achieve these ends 
will most likely continue to be realized in softwar®. It 
becomes evident that the development of programming 
languages to facilitate AI research must occupy a place of 
high priority. "Theoretical and practical advance" in Al is 
dependent upon it [5] . 

A programming language for AI interests invariably has 
more demanded of it than one used for general purpose 
computing. Tasks in AI involve an enormous amount of 
database updating, searching, and manipulation in order to 
discover or deduce the solutions from a large store of 
knowledge pertinent to the problem at hand. For example, 
consider a system like INTSPNIST, created by H. Pople in 
1975 to "provide cognitive support in the formation and 
solution of difficult clinical problems in internal medicine 
[40]." Its knowledge is represented in two element types. 
Either something is a disease entity or a manifestation of 
some disease. There are about 400 of thp former and well 
over 2000 of the latter (see Appendix 3). Given that each 



14 



disease entity is associated with a list of manif es ta t ions , 
c method must te derived for entering the ?cnowled^e lase at 
a reasonable location in order to begin a sensible search. 
In INTERNIST this is assisted by the fact that the database 
is partitioned semantically around organ systems. Cnee a 
start point is found, backward chaining on a conceptual tree 
representation of the knowledge could take pla-'® as actual 
symptoms are matched to the system's manifestations, 
idditional input would at times be requested, and "backing 
up" would most likely occur whenever there is insufficient 
certainty in the matching process. At such a point return to 
an earlier instance where there was an untried but feasible 
alternative would occur and the search would head in a 
related direction still trying to accurately pin down the 
correct disease. An efficient programming language designed 
to anticipate such needs as backward chainin?-, backtra ckin^^ , 
pattern-matching, and context saving becomes desirable, if 
not necessary, for most AI problems, of which INTERNIST is 
typical . 

INTERNIST is exemplary of another basic cnaracteristic 
of AI programming tasks, that is the manipulation of 
non-numeric, or symbolic, data. Such data includes strings 
of characters that one would find in research with natural 
language systems or matnematical expressions like those 
found in the crem-provers . In general, the sort o*" work a 
computer would be required to perform for Al includes 
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al.?etraic formula manipulation, computational linguistics, 
information retrieval, or automatic decision raisin^, all of 
wnicn turn it into a symbol processor rather than a number 
processor [42] . \ 

Languages dedicated to non-numeric computation are 
>nown as symbol manipulation lansuases. Furthermore, within 
this category there are two types, list processors and 
string processors. These are net necessarily mutually 
exclusive classifications. String and list structure differ 
primarily in the way they are stored internally in the 
computer. 4 "string is a sequence of elementary items, 
usually alphabetic characters" that, are generally, though 
not necessarily by cefinition, tightly paclcsd in sequential 
memory for the saixe of efficiency [44]. A list, on the other 
nand , may be a sequence of items whicn are elementary 
(atoms) or lists themselves. Associated with each item is 
the sequencing information needed t'^ locate the next item, 

usually not in an adjacent location [44]. Lists require more 

/ 

memory than strings because of tne additional locations 
required for the pointers directing tne sequencing. In 
general, lists are easier to modify; insertions and 
deletions can be made by changing a few pointers rather than 
by having to move large amounts of data. 
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list Processing: 

A list processinf' lan^uafe is one whose priniary data 
type is e list. A list is a sequence of elements which are 
either atomic symbols or lists. For example, {A ?. C) is a 
list wnere A, 3, and C are simple units (atoms) tnat stand 
only for themselves. (X(I(Z)d/)) is a list where I and W are 
atomic tut (Y(Z)) and (Z) are lists themselves. 

A word has two parts, traditionally called the 
"address" and the "decrement* . The address holds a pointer 
to the location of the property list, in LISP, holding 
descriptive information for the atom of interest, or to the 
head of another list. The decrement may ‘ poi n t to the next 
list item or an atom although usually the next list item. 
The two previous examples would possess th“ followin^^ 
internal arrangement: 



(A 3 C)= 







A 3 C 

(X(Y(Z)’V) ) = 




Z 
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The basic operations applicable to lists are retrieval of 
the firs't el=Fent and retrieval of the list teat results 
from rernoving the first element, i.e., of accessiCiT either 
the address or decrement part. The basic property cf a lata 
element is that of being atomic or itself a list. The basic 
relation between data elements is that of being identical or 
not [11] . 

A valuable quality of list structure is that it divides 
the data being represented into "maior components which ray 
be accessed independently, and which may themselves be 
nierarchical ly structured [44]." 

An important advantage of a list processing langua^-e is 
the ability and ease it provides tc allocate storage 
dynamically, f^emory space for data structures need net be 
preassigned. Storage for each structure is allocated only as 
needed, and it is almost never in sequential locations. 
Since memory reassignment, as well as assivr.r^nt , is 
dynamic, ther° must be a store of cells available for use 
and mechanisms for obtaining "new" cells from, and returning 
unneeded cells to, that store [4]. The problem that arises 
is in keeping track known as the "erasure problem," is in 
keeping track of used, unused, and "erased" memory cells. 
One method of handling the problem is for the programmer to 
reclaim cells es they are no longer needed by linking them 
to a 'free storage list.' Another method is that of "garbage 
collection” (see definition, p. 64 )* 



IS 



List processin.-' languages advantageously provide for 
'recursive definitions of routines. Recursion is dep<=ndent on 
dynamic s t cra^e allocation for efficiency since when a 
function is defined in terms of itself the programmer 
usually does not 'tcnow in advance how deeply nested tne 
process will ^o before natural termination. 

The list structure concept was first introduced ty 
Newell, Simon, and Shaw as early as 1956. Newell and Simon 
had designed a system, the LOGIC THEORIST (LT', which was 
tasiced with proving theorems in propositional calculus, in 
particular the theorems in Frincipia Mathemat i ca ty 
Whitehead and Russell. Their objective had been to simulate 
a theory of human problem solving on a computer. IT was 
highly restricted in application but it did demonstrate tha t 
a machine "could perform tasks neretofcre considered 
intelligent, creative and uniquely human [35].'' The language 
they created in which to implement their theorem proven was 
I^L. The LOGIC THEORIST program consumed vast amcunts of 
memory so there was no possibility of allocating"* stora-^e 
permanently for any particular function. Raced with limit-d 
computer memory, they devised the list structure. It turns 
out, as well, that the representation of data in lists lends 
itself nicely to the simulation of human thinking processes. 
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likp 



most 



languages 



available in 1956. I?I was 



primitive. Frotrams written in it closely resembled Tacnir.e 
language programs (see figure 2a). Storage allocation, 
including retrieval of abandoned list cells for re-use. was 
entirely the responsibility of the programmer [43] . It us-d a 
sequential control scheme with some provision for two-way 
branching and subroutine calling. There was no distinction 
made between main program and subroutine. Any routine could 
call any other. Translation terminated only a^-ter tn»= 
highest level routine terminated [43]. The programmer was 
responsible for parameter passing. Recursion was easily 
achieved since any routine could execute itself as a 
subroutine. It was possible to call a routine with a name 
that was supplied as input data, or to construct arbitrary 
lists at run-time in the proper format for a routine and 
then execute that routine. Furthermore, since a program 
could also manipulate existing routines, an IFL program was 
self-modifiable. 

In 1959, not long after the appearance of IFL, J. 
McCarthy introduced his list processing language, II5P. Eis 
intention was to make the ideas innerent in IFI ('and H. 
Gelernter's plane geometry theorem proying program) cleaner, 
more elegant, and more powe rful [35] . LIS? was more readable 
than IFL. Storage allocation and deallocation were made a 
system responsibility via a garbage collection alccrithm. 
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(s2ip first element) 
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H0 




(get current element) 




J65 




(insert at end) 
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(delete from top and stop) 



An I?L pro< 5 rain to reverse the order 
of elements in a list 
(reprinted from [A3l). 



Figure 2a 



An additional and still valuabl^^ quality of IIS? is the 
capability to represent instructions as veil as data 
internally in a list structure. Thus, pro.cra[n and data are 
indistinguishable. A program may in fact be data for itself 
or another pro^^ram. This allows programs to use tr.eir "their 
list-processing abilities on thems'=lves to m, edify themselves 



McCarthy strove for, and to a great extent ac.hieved, a 
quality still unequaled in its comprehensiveness by rest 
other languages: that of mathematical neatness. His goal vas 
to "allow proofs of properties of proerams usino" ordinary 
mathematical methods [c4]." He was able to do this by basins" 
the lan^ua^e cn the lambda calculus. 

IIS? programs clearly demonstrate another advantage of 
the use of recursion, namely clarity and simi-licity of the 
propram text for iterative procedures. The fipures below 
provide a simple illustration of this fact. Figure 2b 
contains IIS? code ^or a routine to reverse the elements of 
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an artitrary list. ?i,?ure 2c is a TI/I-S2 routine to perform 
a similar task:, i.e., reverse the characters in an arbitrary 
sentence. Eventhougn the FL/I-S0 routine need not «orry 
about individual elements that mi?ht themselves be sentences 
it is still a great deal longer. 

Other 'list prcressing' languages includ‘d FIANM?-. 

.CCNNIVZF, FROLOC-, INTZFLISF, and 0II3F. 

(F.2VIIST (LAMFDA (LIST) 

(CCND (null list ()) 

(T (AFF3ML (FEVLIST (CDF LIST)) 

(CONS (CAR LIST ^)))) 

LISF 

(Reprinted from Siklossy, 1975) 

Figure 2b 
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TP ve rse : 

proc options (nain); 
d c i 

sentence ptr, 

i wordnode iDased (sentence), 

2 word char(3£) varying, 

2 next ptr; 

do while ( 'I'h) ; 
call read ( ) ; 
if sentence = null then 
stop; 

call w ri te ( ) ; 
end ; 
read : 

pro c; 
del 

newword char(30) varyine-, 
newnode ptr> 
sentence = null; 
put SiCip list ( '■'fhat ' up? '); 
do while ( 'l ' L ) ; 
get 1 i 5 t ( neww erd ) ; 
if newword = ' . then 
return ; 

allocate wordnode S“t ('newwcrd'; 
newnode->nex t = sentence; 
sentence = newnode; 
word = newword; 
end; 

end read; 

write: 

proc; 

del 

p ptr ; 

put skip list ( 'Actually . 

do While (sentence = null); 
put lis t(wcrd ) ; 
p = sentence; 
free p->wordnode; 
end ; 

put 1 i s t ( ' . ' ) ; 
put skip; 
end write? 

end reverse; 



?L/i-se 

(P.eprinted from the ?L/I-Applications G-uide-195«;'' / 

Fie:ure 2c 
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String Processing: 

The basic idea of a strinar processing lan^uaee is that a 
program consists of an orderec finite set of transformation 
rules, an ilea inspired ty f^arkov al^eor i thms . Each of these 
nas a left-hand-side describing the composition of a string 
of characters, and a right-hand-side specifying a 
transformation to te applied to a string that it to m.atches 
the pattern described by the left-hand-side [12j . Pules are 
applied in order of tneir appearance in tne text, in so far 
as is appropriate. At every step the first applicable rule 
is used and the process is repeated until no applicable rule 
exists, or until an explicit stopping condition is given. A 
very simple example of this process is sho «n be 1 cv . 



Transformation rules: 

1. -b / ab 

2. bb / ba 

3 . aa / a b 

Given: bbabaab Produce: abababab (i.e. a 

sequence of alternating a's 
and b's, beginning with a 
and ending with b' 

new string: 
abbbabaab 
abababaab 
ababababb 
ababababa 
abababab 



Application order of rules: 

1 . 

2 . 

3. 

2 . 

4. 

done . 



24 



A String may be thouebt of as a vector, array, or 
anything that specifically represents an ordered sequence of 
elements. However, the number of elements in a string is net 
predetermined and may often vary dynamically [3] . 'iVhereas a 
list is a particular way cf representing information in a 
computer, a string is one of the types of information that 
may be represented [48]. In otner words, a string is a list 
whose elements can not be lists. 

The basic operations performed on strings include 
searching for patterns and transform'ing them into different 
patterns. The basic units of a data string, called items, 
may be either individual alphanumeric characters, special 
characters, or pre-speci f ied strings of characters [43] . 

Strings have been used primarily and conveniently in the 
representation of text material, such as sentences in a 
natural language or any arbitrary sequence of ^hara^ters 
from some particular data arta. 

String processing was first featured as a furdament-^1 
data structure in tne CCyiT programming ianeuage introduced 
about 1958. Developed hy a grou.p of researchers working 
under the direction of Yn£?ve at yiT, it was designed in 
order to "provide the professional linguis’: witn a 

proe'rammina’ system in which he could easily write t’^e 
programs needed for nis res earen [48j . " 



is prir.aiily a sequentially controlled lan?ua^?e. 
The prc=sranr,rrie r defines a sequence of "rules" that are 
ordered in the oro^rrari on some arbitrary priority. lach rule 
specifies a desired input that if found dire-^ts tne action 
in the rule's output specification to he taken. There is 
provision for brancning, looping, closed subroutines, and 
recursive subroutines. The programmer is responsible for 
keeping track of parameter passing. 

A COi^IT program is not very readable (see fi^^ure 2d', 
although much of its <=arly popularity was due to the actual 
ease of writing and using the language. COi*’!? has served as 
the model for the type of facilities needed fcr string 
manipulation, and virtually every language which has 
included features of this kind nas based them to a large 
degree, in spirit as well as notation, on CO'-ilT. 
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Application : 

The choice of a list or string procassins lani?ua^e will 
usually depend on tne nature of the programming problem, 
"strings are more useful for linear comparisons, lists for 
structural access [4'*]." In natural language analysis of 
translation, written strings of characters have been found 
to represent spoken strings of sound in the nost natural 
way, since language normally occurs in linear sequenc<=s. 
Lists are most appropriate for tasks wnerein some data 
hierarchy is known or suspected to exist. 
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III. DATA ST.RUCTUB^S 



The earliest programrinf^ languages manipulated only 
scalars and arrays since computers were most useful for 
numerical problems. Consequently, not until the introduction 
of symbol manipulation lan£-uages allowing computation on 
nonnumeric data items, did the field of Artificial 
Intelligence, for which the computer is the major tool of 
research, come into existence. In fact AI finally received 
attention from the computing industry as a serious area of 
research with the development of the first programming 
lan^ua^?es designed for its needs. These languages were I?I, 
LIS?, and COtdl'^. The first two are list processing larguages 
and the third is a string processing langua.o'e. Cut of the 
three LIS? acquired tne most popularity in and out of the A I 
arena . 

It is extremely important, no matter what tne field of 
application, tnat data be represented in the most 
appropriat-^ly direct and simple manner possible. In AI this 
becomes critical as most programming tasks bump tne upper 
threshold of the computers available memory early in the 
processing. Thus a programmer never wants to allocate more 
storage than is absolutely necessary at any point in The 
processing. A major breakthrough in this respect was mace 
with the invention of the list data structure wnich makes 
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convenient tne dynamic allocation and deallocation of 
memory. List structure is also a perfect venicle for 
recursion (see definition, p. 93), now a capatility often 
taken for granted in most languages. The list structure 
alone is not sufficient for all types of AI programming 
tasks. For example, th“ EEARSAT-II speech understanding 
system is implemented in SAIL wnerein this system ray take 
advantage of the set data structure and association data 
type . 

"Before continuing, a suttie distinction tetweer data 
type and data structure must he drawn. Fundamentally, a data 
type is an interpretation applied to a string of hits [65]. 
It may he structured or scalar. A scalar data type in^ludas 
real, integer, aoutle precision, complex, logical, 
character, pointer, and label. Structured data types include 
arrays, sets, records, lists, etc. That is, they are objects 
made up of elementary data types. Fcr instance, an array is 
a set of index-value pairs. An array is usually assigned 
consecutive memory locations, but net necessarily. For ea^h 
index (usually an integer'' which, is defined there is an 
associated value (usually numeric). The structured data type 
becomes a data structure wnen it is associated with a set of 
well-defined operations that may bp performed or that -^ata 
type? to create, delete, access, or modify it. Usinm thp 
example of an array again, it can be created by naming or 
declarihe" its size before it is referenced. A value may be 



f 
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retrieved "by specifying the index essociated ’*ith that 
value. It may be stored sirrilarly. lata striK-ture operations 
may be considered as a "definition" of a data type . 
Furthermore, a "data type specification" (scretimes referred 
to as an abstract data type) is a representation-independent 
formal definition of each operation of a data type [24]. 

In the past, programming languages l°ft the 
responsibility of creatine, indexing, and accessini? data 
files to the ' programmer . However, the newer languages 
provide built-in automatic mechanisms for handling large, 
relatively permanent information files conveniently. The 
exploitation of associative memory for structure storage and 
subsequent information retrieval (a pattern matching 
operation) is one example. Most of the new languages are 
list processors. Besides the facilities for dynamic storage 
allocation, they provide automatic garbage collection (see 
def init ion , p . 64 ) . 

The programming languages devploped for AI have been tne 
means by whicn some of the more novel inventions in data 
representation have been introduced. The remainder of this 
chapter will focus on the descriptions and implementations 
of the most interesting and important of tn^se. In 
particular, they are lists and strings, tuples, bags, and 
classes, sets, encapsula ted. da ta types, semantic networks, 
property lists, associations, and contexts and frames. Some 
miscellaneous terms and concepts are also defined. 



A. LISTS AND STRINGS 

TJie notions of list and string structures were 
introduced in the preceding chapter. In general lists are 
considered to te the fundamental data type for AI languages . 
The concept was originally put forth with the introduction 
of IFL in 1957. lan^uases which feature list data types and 
structures since that time inc lude : LIS? , OL I SP , INTERIIS? , 
PLANNER, CONNIVER, LEAP, SAIL, and POPLER. It is interesting 
to note that INTERLIS? and CLISP are extensions of LISP. 
Also that PLANNER and C0NM7ER are translated into IIS? 
before being compiled. 

The strine* data structure provides a means tc manipulate 
character data. COMIT (1957) was the first langua£,e to 
utilize 'this concept. Since then only 3NOSOL remains as an 
efficient and popular string-oriented language. 

P. TUPLE, BilG, AND CLASS 

These three structures are similar in nature as they all 
represent some ccllection of it^ms. All three are prcvided 
as standard features in CLISP [45], whereas in TRIOS they 
may be constructed via a special data type specification 
mechanism. 

TUPLE. A tuple is similar to a list but may be accessed 
ass oc ia t i ve ly . A . tuple may be asserted (placed in the data 
base), deleted (removed from the data base), cr retrieved 
from the data base. Por example, consider the tuple: 



(AT M?S 



The statement ASS3ET(AT NFS MONTiRST) woull store that tuple 
in the data base as a true fact by placing the attribute 
'^ODELVALUFI with the value T on the property list for the 
tuple. The statement IS(A.T <'-thing NFS) would search the 
data base trying to find a value previously asserted in a 
3-tuple between the items AT and NFS. The search would be 
done associative!/ . For example, if the tuple (AT Cr’ILIANS 
NFS) were stored in the data base with a T value for the 
I'-IGD ELY ALUS attribute in its property list then the value 
'civilians' would be returned for the pattern variable 
'<~thi ng. ' 

FAU. A bag is a "multi-set, an unordered collection cf 
elements with possible duplication" [^'^j . Thus, flAG A A 5 
C) is equivalent to (LAG AGFA) but not equivalent to (SAG 
A B C ) . 

Bags are useful for "describing the argument lists of 
associative commutative relations” fSacerdcti, et al, 19"6] . 
Suppose the relation PLUS were defined for a bag-type 
argument, then the expressions PLUS (A A 3 C) and PLUS (A C 3 
A), which are both internally represented with (FLUS(BAG A A 
EC)), would be equivalent, by definition [47], 

CLASS. A' class, on the other hand, is an unord®red 
collection of elements wherein repeated elements are allowed 
but the internal representation ignores tne dupli ca ti cns [4'' . 
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Classes, ba/?s , and tuples may he used together in a 
statement to separate different types of elements. Jor 
example, consider the following- statement and subsequent 
request : 

On the ’Kitchen table there is a cup, coffeepot, 
newspaper, and toast. In tne living room tnere is a 
newspaper on a chair, a TV, and a lamp. 

Wnat is on the kitchen table that is also in another 
room? 

The two statements could be represented more formally 
as : 

( CLASS (TUPLS ON 

((BAG cup coffeepot newspaper toast) ki tchentable ) ) 
(TUPLE IN (BAG (TUPLE ON newspaper chair^ tv lamp'' 
livingroom ) ) . 

One could at this point set up a template usins- special 
pattern variables to specify a matcning operation to deduce 
the information requested above. This could in fact be done 
with the list representation: 

(CLASS (TUPLS ON (BAG <-X <-<'-U ki tchentable ) ) 

(TUPLE IiM (BAG <-X <-<-V <-Y)) 

where the variables prefixed with arrows are unbound pattern 
variables tnat will be bound wnen a match is found. In this 



example they receive the biadinss: 

TJ=(3AG cup coffeepot toast) 

I=newspaper 

I=livin.eroom 

7=(3AG (T7PLS ON chair) tv lamp) 
where "newspaper (X) in the livin^rooir (f) is the answer to 
the request. 

C. SET 

Basically, a set type represents a finite unordered 
collection of items (of the same type) containing at most 
one occurrence of an item [ISJ . Thus, a set is also a class. 
Although, a class may contain a collection <'f it^ms of 
varying types whereas a set may not. Some lan^^uas’es (e.f.. 
LEA?) do require an ordering property. Sets form the basis 
for the APSST lanffua,?e [16] . LEAP and SAIL also provide 
built-in functions for application to use r-def i ne'’ set data. 
The basic operations on spts are union (conjoinine two 
sets), intersection (finding common elements in two sets', 
test for membership, and insertion and deletion of 
individual items. 

The set concept can be a powerful one. It provides 
clarity and a good foundation for ways of acnieving 
repetition. Pepetition formulas sucn as "tois is true for 
all members of tni s set" are used in place of ’go ^o" 
statements or recursion. Since ASSET is mor® strongly 
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set-oriented tnan any of tne other lan^-uaises a closer I 00 .-C 
at scrre of its features is warranted. 

In A BS ST , sets can "be defined in a .eeneral way, for 
example, as all tnose items satisfying a certain predicate. 
The domain and range of every function (all functions must 
he total) are specified in terms of previously defined seas, 
lor example if c is a new set being intrcducea it may be 
defined in terms of a preexisting set and an equivalence 
relation defined for that set. Some 5et A may have several 
relations defined for it. If a is the set of all fracticr.s 
we could create the equivalence set TvO-THIATS w>'ich 
contains all fractions that reduce to ?JZ. 5 might th‘='n ^e 
sim.ply defined as the set equal to k according to the 
equivalence relation TWO-THIRDS. 

The set structure is built on the following functions: 

IN (the usual se t-nembe rs n i p predicate, yi<=l'’s 
a boolean value) 

RQWInsRT (gives a equivalence relation over a set 

* 

referred to earlier' 

SITRf^ (gives an item of a set, if emptv gives 
an arbitrary item) 

SRi^! (gives a set wnicn is tne same as tne 
original, but excluding tne item 
specified in the SREy expressicn'i 
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n'Jr? (a function that outputs tn= urior of tvo 
se ts ) 

POVF (a function tnat eives the set of functions 
frorT’ one set to another) 

UrTOF (a function that outputs an orle^'ed set) 
TH0S3F (a function tnat outputs a set of all iters 



of a riven set wnicn setisfy a iven 
predi ca te } 



Thus , if setl= ( a 


b q z 1 , the n 


3 ?. E*'" ( s e 1 1 , G 'i yields 


t V p 


set (a b z ) ; 

i 


IN ( se 1 1 , p } 


yields a false value 


. If 


SFT2=(7,2,9.2r, 1. 


9 , 5 1 , C , ?. » 7 ) 


, SE?.?=Foo leans , 


dni 



.'SFT4=Integers then 



L' T b, T*xj“ 



^HOSEOF SETS IN ;ET4= (7,23,51). 

The motivation for the ie'^e lopmen t of ^.FSET '*as to 



distinguish 


te tween 


an ordering 


of cecisions 


and an 


ordering of 


eva lua tier. [16] . " 1977], 


Th® desire was 


ic c'r^are 


a languare 


that does 


not force 


the programrer 


t c c a r i V 



''crni tmen t of decisions he or sne would rather prefer to 
postpone. For example, after indicating? an ol}je'’t is an 
array, it snould be possible to defer declaration of its 
size, or if it is a procedure to defer specification of the 
details of the corresponding algorithm. The set concept vas 
considered a natural vehi'cie for achieving these reals. 



D. SNCAPSULAT2D DATA TIPS 

Sncapsula tion is tne process of defining a data 
structure from a user-specified data type alone with a 
specification of tiie type's structuring metnod and tne set 
of procedures that deternine the priiritive operations Lo3] . 
An example of the encapsulation of a tinary tree data type 
(torrowed from [24]) is shown in figure 3a. 

In tne TELOS 1 anguage'' a"capsule data type generator" is 
provided to assist in constructing "capsules (encapsulated 
data types)." TELOS does not directly provide the user with 
lists, classes, bags, trees, or graphs. However, all of these 
may be easily constructed with the use of tne capsule 
genera tor. 

The capsule structure provides localization of 
representation of detail, tnat is, scope or context witnin 
which the specified type is applicable. This is a powerful 
data abstraction mechanism that combined with TELOS 's 
control abstraction mechanisms is ''apable of establishing a 
simple and direct means of implementing nign -level 
theoretical concepts necessary for the developmert of a 
general theory of intelligence [59] . 
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type rinarytree [i teF] 

declare ir^PTYT?. 3E( ) -> Pinarytree 

(Sina ry t ree , i ten ,3 i p.a ry t ree 5i 
ISS^^FTYT?.Ei(Pinarytree) -> Pooleaa 
IsrT(Binary tree! -> Pinarytree 
DATA ( 5i nary tree ) -> item 'J {UNLSriNEL} 
3IGFT(Einarytree) -> Pinarytree 
IS IN ( M nary t ree , i tern ) PooleanJ 

for all l,r Pinarytree, d,e item let 
ISEr"?TYTEEE(EMPTYTRSE) = true 
ISEi'"?T^TPES(maKSU ,d ,r) ) = false 
LEFT ( EMPTYTP.EE ) =SMPTYT?:EE 
IEET(MAKE( 1 ,d , r) )=1 
DATA (E'^?TTT^EE)=UNDEEINEr 
DATA(MAKE(l,d ,r) )=d 
RIGHT (SMPTYT?.ES)=EMPTYT?.EE 
PIGET(MAEE(l,d ,r) )=r 
IS IN ( EMPTYTREE, e ) =f a Ise 
ISlN(MAKE(l,d,r) ,e)= 
if d=e 



end 

end Pinarytree 



then true 

else ISIN(l,e) or ISIN(r,e) 



n a r 7 1 r e 



Usin^ the encapsulation above a sirrple proprar rray be 
written to construct a binary tree and extract the left 
sub t ree : 

TRSE1=EMPTYTREE( ) 

TPEE2=EMPT’^TREE( ) 

TREE3=EMPTY?RSE( ) 

TREE1=MAKS(TREE1 ,A,TREE2^ 

T?SS2=MA.EE(T?.EE2 ,3 ,TT5EEo) 

TREEe=MAKE (TREEl , C ,TREE2 ) 

LEET(TPSEe ) 

The implementation independent way of evaluatinp; an 
expression involving the operators of the data structure 
would yield: 



LEFT(MAKE(MAKE(EMPTYTRSE( } , A,EM?TYTREE( ) ) ,C . 

(^AKE(EMPTYTRES( ) ,5 , EMPTYTE EE ( ) ) U . 

This reduces to 

MA^E(EMPTYTRSE( ), A, EMPTYTREE ( ) ) 
wnich is equivalent to A) 

Snca psula ti on of a Binary tree. 
Figure 3a 



PROPSHTT LIST 



A property list is a structure used ia list processina 
languai^es and is associated witn an aton. It is a list made 
up of a 1 1 riliu te-value pairs. The size of the list is not 
fixed and may sarink or grow during computation [ij via 
special functions for inserting and deletins- a 1 1 rihute-va lue 
pairs. In LISP, taese are 'putprop' and respectively 
L63] . 



Example of a property table representing a property-list: 



Colorado S. 






Toad 





C ommo n 




Toad 






Attribute; 


Value; 


’ Color 


Ik. brown 


A V e . ? i 2 e 


6 i n c n e s 


Croak 


low 


Kabi ta t 


lesert 


Other Members 


Common Toad 


Same Family 


Woodhouse Toad 



Thought of as data stri:cture abstractions, property 
lists are symbol tables, as the “xample above illustrates. 
The name entries are the properties and the value-entries 
are tae property values [ll . An attribute nay also name a 
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relationship between the described cbje''t and other obje'^ts, 
wnere the value identifies the other party or parties to the 
relationship (see last entry in example above) [441. In a 
data base, equivalent expressions will nave the same 
property list [47] . 

Property lists were first introduced to prco-ramminc 
languaf^es in HL. They are basic stru<"tures for any list 
processing lan;?uase. No atom has meaninp without sore 
specification of its characteristics in some context. Py the 
same to’cen, no property list is accessible unless it has 
explicit association to some atom. 

In LI??, property lists are incorpo rated into the 
language features that is, functions for rjianipulatin^' t’''-<=r 
exist as built-in operators [22j . The internal 
representation of the property list shown above would appear 
as follows (demonstrating that a p-list is a list of 
associated pairs): 



Colorado F. . Toad- 




The LISP functions that are used to manipulate property- 
lists include [63] : 

GET(T T ) which searches a list X for an attritute which 
matches T. If such an attribute is found then the next list 
element, i.e., the attribute's value, is returned. Otherwise 
the value of C-TT is NIL. 

PTJT(X Y Z) puts on a property list of literal atom 7 the 
attribute followed by value Z. »ny previous is 
replaced by Z. The value returned for PUT is Y. 

PPOPC''' ^ ru ) searches list X for an attribute equal to 
Y. If one is found, the value returned for PEC? is the rest 
of the- list ■beginning immediately after that attribute. 
Otherwise, the value is PN( ) , where EM is a function of no 
a rguments . 

REMPROrfX Y^ removes all occurrences of the attribut'= Y 
and its value from property list 1 . The value returned is 
-ML. 



4:1 



?. S2MA.NTIC fJET'/ORKS 

A senantic network (net) is a ^raph define! ty objects 
and their property lists (list of attribute-value pairs 
describing the object). The object and -the values are 
uniquely represented by nodes wnile attributes label arcs 
[23]. A progran' can traverse the graph in a serr.an t i ca lly 
ordered fashion by starting at the specified node of 
interest and following arcs sequentially to nearby related 
nodes. This is an appealini? notion in that it seerrs 
analogous to the way tne human brain will jump from one 
related idea to another. 

^^ost of tne work on semantic memory representation has 
been dene with respect to natural language unders ta nd i n;?. 
The original intent of such research is to represent 
semantic knowledge in a computer in tne way in which humans 
would store such knowledge in the brain. A data base 

partitioned into a semantic ret provides inferencing 

capability. In other words, a pro^-ram can ferret information 
from the data base that is not explicitly represented, 
value of this quality is in not havin? to clutter the data 
base with noncritical facts tnat are derivable from otner 
facts already present. 

A semantic net scheme devised by Cuillian (see figure 
3b) segments the data base into "planes." A place is a 

collection of concepts (nodes) connected by directed arcs 

(pointers) which together represent a certain semantir' 
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"lopic"; a distinci piece of knowledge. Pointers are usea 
extensively to connect related nodes witdin planes (solid 
arrows) as well as between planes (dashed arrows). Pointers 
between planes point from node to plane, ratner than node to 
node. In figure 3h there are four topics, three concerning 
various meanings of the word, oiant; one naving to do witn a 
particular meaning of 'food.' Additional knowledge (planes) 
may he added to the net. Modes may he connected erplicitly 
(within the plane) and implicitly (between planes) hy 
initiating a pattern search throughout the data base 
network. Information may he retrieved from the net hy 
requesting that one or more r= la t igui ships , if they exist, he 
found between two topics. The program would start at one 
node of interest, follow arcs to related nodes, then follow 
from those to still mere distantly relate-i nodes and so on 
to retrieve a related concept. 

Semantic nets nave also been used in visual scene 
analysis [64j . Figure 3e is a picture of a simple aren and 
an initial representation of it in a semantic net. 5 the 
program is exposed to other examples and varieties of 



arches , 


and 


s tructures 


that are 


not- exactly a r c n e s 


tu 1 


similar, 


tni s 


simple net 


may be r 


e f ined and expand ed 


to 


account 


for 


various arrangements 


by adding nodes ard a 


r ^ s 



specifying possible additional parts and relationships ^es 
in figure 3f). Ine final expansion also contains all 
information learned along the way, e.g., in the example, A 



I 



J 



I 

I 



} 

ilJ 



I 



1 



i? not merel:/ sup poriea by 5 and C as ’^as assumed in tbe 
besinninff. It was discovered that A must in fact be suported 
by B and C. Later a new structure mav te described and a 



determ.ina tion made by 


the prosTam 


as tc whether it ri^'ht 


r e 


a sort of 


arcn based on 


a pattern 


matcn attempt between 


111 e 


network 


represen taticr 


and tne 


actual ccmpcrents of 


ite 


object . 


Fur the rmp re , 


ques ti ons 


may be asked about 





results of tb-e matcbinr process. 

A.S m.en.tioned earlier, a valuable ouality of semantic 
networks is that tney allow i nf er'en c in^r of information nor. 
f=xplicitly stated in the data base. This cai-ability can ’'p 
demostrated by means of a dialogue that occr.rred between 
r.aphael and his semantic information processinfj pro^^ram . S.I- 
[-^1] . Figure oc snows tne acti’.al uialoeue and fi,.ure 3d 
depicts the semantic representation where the nc.ies are 
objects or nouns and the arcs are tnei" asserted 

relationships, '"ne informiaticn being scugnt is the numf^'r cf 
John's fine-ers All that is explicit in the networm is that 
Jonn has two arms, each am nas one hand, and ea^r. hand nas 
five finders. Once the necessary relations have been 
established, as the diagram shows, tne program calls a 



procedure that 


is invoked wne never 


the 


task is 


tc 


reply as 


to now many 


elements of tne s 


ei 


X are 


part 


s of tre 


individually, " 


where npre .x=-fingers 


and 


7 = J cn n 


• 


e a n s w p r 


is computed 


by tne procedure and 


tne 


program 


rape 


p * c i_ r p Q 



be "IG" [41]. 






I 






Although semantic networts are not actually featured as 
data structures in any of tne AI lanfua^es considerea, it 
nas become an important scheme for data base organization. 
This is true for the reas.on just cited as well as tne fact 
that they are relatively easily implemented with the new 
list processing: languages. 





The inferencine capability of Quillian's nets may demonstrated 
in the example as different planes are shown to have intersections 
(live, for plant and food; sad, for cry and comfort). The claim is 
that the distance from the planes to their intersections is dir- 
ectly proportional to the relatedness of the concepts. 



Semantic Network - Quillian 
Figure 3b 
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A Soy Is a Person^ 
n Understand) 

John IS a 5Cv) 

(I Understand) 

, A Finger Is Part of a Hard) 

(I Understand) 

^ jtq^ Many Fingers Does Foiin Have Q) 

(The above Sentence Is Ambiguous But I Assume (Fas) 
Means (Has As parts)) 

(I Don't Know Whetner Finger Is Part Of John) 

^ There Is One Hand On Fach Arm) 

(I Understand) 



( . There Are Two Arms On A Person) 

(I Understand) 



ManyFingers Does John Have C) 

(The Above Sentence Is Ambiguous But I Assume (Has) 
Means (Has As Parts)) 

((How Many Finger Per Hand C)) 



A Hand Has 5 Fingers) 

(The Above SFntence Is Ambiguous But I Assume (Has) 
Means (Has As Parts)) 

(I Understand) 



How Many Finders Does John Have I) 

( Tne Above Sentence Is Ambiguous Put I Assume ( Fas 
Means (Has As Parts)) 

(The Answer Is 1?) 



Semantic UetworK - 'Raphael. 



Figure 3c 
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r e r s 0 n 




Semantic i\et picture. 
rlGUnS 3d. 




SemaPxtic Net - '/inston. 
Figure 3e 
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G. ASSCCIATICN AND ASSOCIATIVE RETHIZVAI 

fiany of th= new lanp'uaf^es recoirnize that ]3rovision of the 
capability to store and access data associativelv ^i.e., on 
the basis of some property it possesses with no re?'a"rd to 
name or location) a basic necessity for current and future 
research. CLISr, SAIL, LEAP, FOPIE?., and TELOS all provide 
for an associative data type and therefore, associative c.ata 
base organization. This powerful mechanism is critical tc 
the construction of goal-oriented systems, wnere procedures 
to be tried for reaching a goal are identified by 
description rather than by name. Purthermore, it enables tne 
appending of procedural or declarative chun>s tc a 
••enow ledge-based data store. Subseque^'t use of these chunks 
is determined by some control abstraction (e.g., a demon, on 
the lookout for an instance of a certain situation) whose 
specification most likely preceded the entry of the chunks 
Into the system [59]. 

In general, an association data structure is a 
tnree-tuple of data elements of the form iteml itemE = 
items [18]. For specified sets of items an association is 
executable. For example, the following three-tuple: 

h!AKE - AUTOr^OBILE = FIAT 
could be analogous to the executable statement: 

foreach x such that x in AUTO'dOFILE do kAKE.x = FIAT 
which instructs that all elements (x) in the set ” AUTOI^OSILZ" 
will have their 'VaKE'* property set to ”FIAT’. Thus, the 



primary interest is in attribute values of one or mere s=t 
elements. In the example » AuTCyCIILE_ ' i tem2^ is the set, 
^)AKS (iteml) is the attribute, and FIA? (item.3) is the value 
of the at tri bute [4] . 

One obvious application of association occurs witn the 
implementation of a property list as a list of pairs 
(property, value) United to an object. However, from a user 
point-of-vie w this scheme is handicapped, as it is one-way. 
?or instance, there could exist a situation where a list 
contains sublists of three atoms each, representing three 
things that a family might own such as an automobile, a 
house, and a net. Eacn has a property list as snown in 
figure The problem arises when one has a value with no 
idea of what attribute it belongs to. The value could be a 
number like 197Z. This could stand for the year of the auto, 
the year of the house, or the square footage of the house. 
Associative retrieval based on wanting to know the value for 
a specified attribute is acceptable since the order and 
determination of attributes is known for each p-lisi". Ther° 
is no way to find an attribute based on an arbitrary value 
save to brute-force a pattern maten through every ceil of 
every p-list for each element of the set. Suen a search 
would require an enormous (if not unreasonable) expense in 
bookkeeping and time. SAIL and LEA?, however, provide a 
storage scheme that allows such a "backward" associative 
retrieval operation on p-lists. It is done cy designating a 
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continuous block of storage for each p-list ir which each 
attribute is assigned a relative address. A hashing scherre 
or. values is tnen used to store and retrieve the attribute 
data [18]. This setup allows the flexible access of items in 
a p-list either by attribute or value. However, it also 
implies a requirement of twice as much storae’e as usual. 



(AUTO HOUSE PST) 




■Property Lists. 
Figure 3.m. 



H. CONTEXTS AND FP.Ar^SS 

There is not universal agreement on the meaning- of the 
words context and frame. Some use them synonymously, yet 
others draw a distinction, albeit a subtle one. For 
instance, context represents an implemented pr cgramnint-' 
mechanism, whereas a frame refers to a data structuring 
concept only. This policy is sufficient for the purposes of 
tnis discussion. In a rough sense a context may be thought 
of as a "viewpoint on a data bas“ [47]." More specifically, 
it is a data structure representing previously stored cnunks 
of stereotyped knowledge fe.^., driving to work, maki.ne a 
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pnone call, typing a paper, etc.) [9j . It is provided as a 
limited attempt to implement 'linsity's complex frame lata 



structure idea in OLIS?, COMNI7ER, and PCPLEP.. In tiiese 
lansua^es , the mechanism works in the following manner: all 
expressions in the data base are factored into segments, 
each of which may be referred to as a "context." Assertions 
may be entered and subsequently retrieved from the data base 
with respect to a context. (This is analogous to a "blcc>" 



in a block- 


-structured language.) The contett may be 


manipulated 


explicitly or by d®fault (i.e., based on the 


structure of 


the flow of program control) [4j . Por example. 


consider th® 


CONNIVSR program module: 


1 . 


(?nOG(Y) 


2. 


(S3TC T 17d) 


3. 


(SETw VAR2 (TAG LARL') 


4 . 

W • 


(SSTO VARl (FRAME)) 
(-^INT 'HFLIO) 


5 • LABL 


(PRINT 'GCODPTE) 



7. 


(SETC T 5P) 


8. 


(RT^INT CSVAL 'Y VARl) 



The routine above demonstrates the use of two special 
commands offered in C0NNI7ER for manipulation of contexts. 
The commands are called PRAMiC wnich creates a pointer to the 
current frame so it may he modified or executed a^ain later, 
and TAG which is similar hut it also specifies a starting 
location within the frame [4]. 7ith respect to the example, 
one could issue a C3NTIN73 7A?.l instruction causing 
processing to commence at statement 4. A CCMTINUP VAP2 
instruction would send control to statement 6. The CZ7AI 
command in statement 8 would cause the value Y (=lCt;) within 
the context of ^A?l to he printed. Th® mechanism in each of 
the three languages works in very much the same way, and 
provides the same principal value, that of allcving the 
programmer to consider alternative situations, without 
changing a global data base, by specifying the scopes cf 
variable bindings, i.®., switching* info^'metional "contexts" 
or "frames” of reference. The frame structure nas 
referred to by many other nam.es incluiins" "script" 'S'^hank R 
Ahelson), "units" (Bobrow & Vinograd), "depictions’ (Kc,y®s', 
and "common sense algorithms" (Rie?er) [3]. 

A new "context" is created, in a program, whenever a 
user-defined block is entered (or a ClAMBPA fun''tion is 
encountered in CLISF). The current "context" is set to be a 
descendant of the previous "context." This is known as 
"pusning" a context [cl]. This means that variable binding's 
and assignment of properties to expressions that are local 



to a context are accessible only from tnat context or a 
descendant context. 



Parent Context T1 



ASSEUTt Signatures are on thesis. 



Eescendent 

Context 



T2 * ASSERT: Thesis is on library shelf. 

(collecting dust ) . 



'rfith respect to the drawing above, scope rules dictate 
that any assertion made with respect to T1 will be available 
to queries made with respect to T2. Thus, if asked wnether 
signatures are on thesis, with respect to T2, the answer 
will be "yes". But, assertions made wita respect to that 
descendant are invisible to queries made with res^^eot to its 
parent, or any other context aside from its own descer.dents , 
Por instance, if thesis is asserted to be on the library 
shelf, with respect to T2, tnat information will not be 
available to queries made with respect to II [61]. 

Marvin Minsky was the first to seriously put forth the 
concept of a frame data structure. He suggests a fram® be 
thought of as a network of nodes and relations. He further 
explains his idea with the following elaboration: 
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The "top levels" of a frame are 
fixed, and represent things tdat ere 
always true about tn? supposed 
s i tua ti 0 n . ^The "lower levels" have many 
" t erminal s"-” s lo t s" that must be filled 
by specific instances or data. Each 
terminal can specify conditions its 
assignment must meet [32] . 

The "conditions" can be either simple (i.e., requiring 
assignment be made to a person, object or pointer to another 
assignment) or complex (i.e., a relation existing among some 
things assi^ne’d to several terminals'! [S4j . All terminal 
nodes are loosely assigned default values thereby conferring 
on a frame many details whose supposition is not 
specifically warranted by the situation. These assi^rnments 
may be easily displaced by new items that are discovered to 
better describe the current situation. 

An example of a typical use of the frame concept is 
borrowed from Winston to now a room could be described with 
a frame in figure 5h [54]. A frame may contain subframes. 



That is, 


a 


frame 


cl- 

4' i- VW 


t may simply 


contain 


a pointer to 


another 




rame . 


In 


the figure e 


ach frame 


slot for a wall 


contai ns 


a 


pointer to 


a wall frame. 


whicn nay 


again contain 



subframes . 



/ 
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?cor Frarre - Yinston. 
Fifrura 3h 
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The frame concept nas stimulated an area of current 
investigation namely, tne "frame protleri." This is toe 
problem of creating and maintaining an appropriate 
informational context, or frame of reference, at earn stage 
in certain problem-solving contexts [42j." The essence of 
the "problem" is booirkeeping. Tnere are an enormous number 
of details to keep track of in the hyuothetical worlds 
resulting from alternative actions which could be taken in 
order to carry out a given task, f^uch of the problem is due 
to complexity. For example, a typical situation mi^-ht 
require a frame description of 1,320 elementary facts. It is 
not unreasonable to think that an average of 6 different 
actions is plausible in any situation and tnat 4 successive 
actions are required to achieve a e-oal state. This implies 
that there are 6 =1296 possible intermediate ani terminal 
situations to be considered. Storing 1,223 facts tc describe 
each of more tnan 1,202 situations means =tcrinc: over one 
million facts, whicn is not yet a feasible thing tc do if 
all facts must be available in main memory [44]. To relieve 
this problem current research is concerned with 
investigating the possibilities of usina state variables 
(each node would carry only change information). This allows 
the incorporation of the "STFIFS assumption [51]” into 
context mechanisms, "he STF.IPS assumption is that an action 
leaves all the relations in the model unchanged, unless 
otherwise specified. Generally, the specification of change 
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is made in "add lists" and "delete lists" which accompany 
tne application of dn operator to a situation. ?or example, 
consider a situation where a car with a driver and a 
sleeping passenger is going down the road. The state may be 
represented hy the assertion of all the following 
predicates : 

MOVi; (car forward) 

HAS (car fourdoors) 

IS (car red) 

AT (driver steerin^wheel) 

SIEEPS (passenger backseat) 

MILES (car 62 K) 

IN (sparetire trunk) 



Now apply the Flat Tire operator. It has add and delete 
lists as follows; 

ADC LIST DELETE LIST 



AT (driver tire) 

IS (driver mad) 

MOVE (car nowhere) 
On (sparetire aile) 
In (flattire trunk) 



AT (driver steering wheel) 
MOVE (car forward) 

IN (sparetire trunk) 



The application of the flat tire operator creates a new 
state waich is different from the first as prescribed by the 
add and delete lists for that action. The entir® model need 
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not be re^jenera ted since it is kno<vn to be the sarre as 
before with the exception of a few nodi fi cations . In the 
example above for instance, without having to be explicitly 
stated it is known that the passenger is still asleep in the 
backseat. The resulting state is analogous to a descencert 
context . 

Similar to a frame is Schank's notion of a script. 
Vhereas a frame usually depicts a static scene, a script is 
used to represent an event, something that includes an 
implicit time ordering. Figure 3i shews a script generated 
by Charniak about grocery shopping. 

The advantage of a frame or script-type representation 
is that it will contain information expected to construct a 
specific ordinary even,t whether static or dynamic. A program 
operating on a frame-oriented data base need be told 
explicitly only that information which is net accurate in 
the frame. For example, a shopper may not use a basket at a 
grocery store, ""he slot for that aspect is loosely bound to 
the value that is initially installed there, rc th frames and 
scripts mav be stored, retrieved, and modified. Fetrievai 
may be done via a pattern match on a goal (frame healing' or 
via a link from a frame slot to another frame or frame slot. 

A ffreat deal of work remains to be done in order to 
^"■ully realize the details of rUnsky's frame abstraction. 
Fut, any progress made along that continuumi will contribute 
to the simplification of inherently complex progrcmmiing 
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tasks as one would find in a question-answering syster or a 
protien-so Ivin^ syst=n. 



GOAL: SHOrPSR owns Fu3.CHASS-IT2yS 
SKOPPi- decide if to use basket, 

if so set up cart-carry Prame Ira.^e 
SECPP2H obtain PASK2T '“cart— carry 
SHO-PEP obtain PUPCHASS-ITEMS 
nethod-sugc-es ted 



EG for all ITEM 
cHOPPSP cnccse 



?UPCHA3E-ITT^'S 
ITEM pgPCHASS-ITEyS-EONZ 



SHOPPER at ITEM 

side-condition LONE at item also 
me thod-sugges ted 

ca rt-ca rry (SHOPPE?. , PAS EET , P0f\E , I TE>‘ ' 
SFGPPSP. bold ITEM 
ITEy in Basket '’'cart-carry 
EONE^-DONE+ITEM 
ENE 



SHOPPE? at CHECH-OUT-CO’JNTE? 

side-condition PHP.CHAS E-I TEMS at CHECH- 
me tnod-sugges t ed 

ca r t-carry ( SHOPPE? ,r ASHET , PEPCHASE- 
CHECK- 0 U T - C 0 U N T E ? ) 

SHOPPER pay for PURCHASE— ITEyS 
SHOPPE? leave SUPSpyARHET 



means o’et tre following frame if 



d^o rcprid 



» rr — -n 
' ' ' »M ^ 



al 5 c 



Supermarket Script 



Oh a rniak 



Figure 3i 
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I. DEFINITIONS FOR DATA STRUCTURES 



1 . Tree 

A ’’tree'* is sitnilar to a natural tree except that it 
is drawn upside down. Technically, it is e directed graph in 
which each node has at most one predecessor. The root node 
(at the top) has no predecessor ever. A node with no 
successor is called a terminal nod=. The lines (all havina a 
downward direction) connecting nodes are called arcs. 

Each nods is associated with a level of the tree. 
Tne level of a node is one more than its distance from tne 
root node. All the nodes on each distinct horizontal plans 
represent another level. The depth of the tree is eoual to 
the nurrher of levels it has. 

Trees may be used to conceptually represent the 
organization of a data base, or the search space for a 
problem. 

Tree nodes are examined for solution in a certain 
order. The most common orderings are breadth-first, 
depth-first and best-first. Breadth-first examines the nodes 
on each level, starting at tne root, in a left to right 
direction usually. Depth-first search, on the other hand, 
travels all the way down the left most branch of a tree to 
the end, or as far as a pre-speci f ied bound. The search 
successively makes its way rightward always going down the 
left most branch till a solution is found. Vhen there is a 
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cost associated wi t£i eacn arc and tne protlem is to find tde 
least cost goal node, test-first searcn is the most 
efficient method, although it is expensive in terms of 
storage. This methoa will chooss to explore past a node if 
the cost on any arc leading out of that node (added to the 
total cost so far on the path) is less than or possibly 
equal to the cost of a path leading into another node at the 
same level, current least cost path. The first goal node 
found will be the one at the end of the total least cost 
path . 

Figure 3j shows a tree with cost values on the arcs. 
The goal nodes are blaclcened. Results from eacn of the three 
search searcn methods is snown also. 




Order of Discovery of Goal Nodes: 
Depth-first Breadth-first Best-first 

3 7 S 

5 3- 

Te- 
as- 

Evaluation of a Tree 
Figure 3j 



63 



2. Atom 



Atom is a term derived from LISP. It is a symijol 
used to name an object, sucn as a variable, function, or 
some object in the world in which the program is operating. 
In a robot world an atom could be a table, or box. An atom 
is the smallest meaningful unit of information. The 
following examples could be atoms in a program: A, X9, SORT, 
WINDOW, FROG, etc. 

3 . S -express! on 

This is a LISP term that is used when referring to 
lists or atoms in general, and neither in particular. 

4 . Garbage Collection 

This is a facility some languages offer for 

examining memory at periodic intervals to determine which 
locations are not currently in use and returning tnese to 
the free list. This is done by following the chains of 
pointers from active list variables. Any cells wnicn cannot 
be reached are considered no longer needed [66], When this 
mechanism is supplied by the language the programmer is 
freed from having to Iceep track of used and unused memory 
which in a list processing language without garbage 
collection requires very careful and attentive programming. 
See also [54j . 
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n. CONTROL STRUCTUR3S 



Control structures are an integral part of the 

pro^rarrmiQ^ en vi ronrent . They provide the frarnework or 

operations for specifying rules directing the flow of 

processing? and interpretation for progratrs or parts of 

programs [Rlj . For example, a control structure might 
include a general rule that dictates that statements he 
executed one at a time in order as they appear in the 

program description. A discussion of control then must also 
include consideration of program sequencing rrles ^or tne 

lack of such) or even the indeterminancy of the desired 

sequencing. 

In early programming languages, flow of control was 
strictly hierarchical, meaning every module (procedure, 
function or any primitive program unit) was expected to 

complete its task before returning control to the module 
that activated it [^] . Processing occurred sequentially 
except when interrupted by iteration or conditionals or 
branches like go to 's [21]. Such limitations on flexibility 
were too constraining when it came to programming complex Al 
systems that accessed and manipulated very large stores of 
knowledge and more often than not, required subsequent 
program control to be dependent on the result of an access 
or manipulation 
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It is little surprise ttien to discover tddt witn tne aavent 
of the "first,” AI language , IPL, a new control structured 
was introduced. 

% 

IPL was originally designed to implement The LOGIC 
THEORIST (LT) theorem-provinff system of Simon and “'iewell. 
LT's tasir was to prove theorems in propositional calculus. 
In so doing it would iteratively apply a variety of logical 
rules to the proposition. A mecnanism was needed to halt the 
application and pursue proof of a sufcproblem and then 
possibly continue where processing had earlier left off. The 
"generator” was that mechanism and it enabled repetitive, 
non-hierarchical processing. It would produce a sequence of 
outputs to which it iteratively applied a specified process. 
Any iteration producing a fals^ (boolean) value could 
terminate the venerator, but not before ensurin';' a possible 
later reentry at that point [21]. 

Cf course IPL was also a list processing lan^uame and as 
such, one of its basic control structures was recursion, 
which is a naturally hierarchical structure. Each recursive 
call creates a separate activation at a new level. 

COI^IT, a string processing language that appeared aboi't 
the same time as IPL, was characterized by a primarily 
sequential program flow. A program was simply a prioritized 
list of rules for replacing, cnaracters in string data. 
However, only the rules that contained a specified pattern 
in a substring of the data were executed. 
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,'^uch ot' t^e power and sophistication cf the 
structures of AI lanfUfiees, over and atove «nat availatle 
in the conventional pr op'rarrr'in^ la^^uat-f^s , is due to the 
inclusion of a variety of deductive recnanisms. These are 
rrechanisfps that provide an autonatic or at least 

semi-automatic data base searcn capability. The more 
automatic they are the more nonprocedural the lan?ua<?e turns 
out to be. The most nonprocedural language is ?LANN'£H ana it 
indeed offers the most automatic deductive mechanisms. 
PIAiN'NSF's primary tool for deduction is the cons-=ouent 
theorem. It has two parts, a pattern statement (?‘ and a 
procedure body (3) which are employed in a C='>? nan rer. Th'is 
if the program T were success -^u lly executed then the 
assertion matched by th“ pattern ? would be proven • 

Trequently the program C requests that an assertion bp 
proven, i.e., that a suhe'oal be achievea. The consequent 
theorem may thus set up a backward '•■haininm mechanism 
searching the data base. Jor example, consider the sitvatiun 
wherein a moal is to assert that there are -'iraffe^ i Sen 



Ticwro : 



GCALdN C-IHAFIES SANDITr-:; 

In the data base mignt be found tne following assertions 



(IN ZOO SANDI2C-0} 

(IN G-IHAxFSS zee ) 

'"he assertion desired is not erpli''itly availa'^le sc tr = 
next step is to find a consequent theorem that would enable 



I ils derivation. The theoren telow wonlc do just that. 

I [CONSECUSNT 

(IN X Z) 

(ahi.i IN X y' 

(GOAL IN Y Z)] 

] 

The first step is to rrat^n the tarf^et patter’^ (IN Z) 
against the desired assertion ^IN GIKAr?E3 SANTIEC-O'. Toe 
body of the conseAuert theors'n instructs that two sucp-oals 
te achieved. The data base is searched for an assertion that 
rnatches (IN GITAFFSS ?^) wher<= ? means that any value f'^urd 
in this position will be acceptable. In the data base is 
found (IN GI-aFFFS ZOO) whicn matcnes. One subfccal nas ’■een 
achieved. The second causes a data base search to fine a 
match for (IN ZOO 7Z). It finds tne fart that (IN ZOO 
SANTIEGC). Thus the consequent theorem nas been successfully 
executed and the assertion nas been proven to be tr’/.®. 
Pattern matchir.i^ capability is fundamental to tne success of 
this type of deduction. 

Other lanp-uaf?es that offer mechanisms as des^'nibed above 

include CONNIu’Zp?, CLIFF, and FCFLFR. In all four lar.^-tua^*®' 

\ 

the data case search is initiated by an explicit poal 
statement. The differences between tnem is the amount of 
programmer interfprence allowed in constraining tne searen. 
In FIAMNSR there is little or no opportunity for tne 
programmer to explicitly direct tne searen process wnerees 



in CCi\iM73R ani QLISr there is a s-reat leal. Ihesp tv.o 
lanpUct'es provide a frane construct whicn specifies 
different data and control contexts. A new frare is created 
eacn time a non-atomic expression is encountered, "^ne frar^e 
contains all the information associated with every 
activation of the access module in which that expression 
resides. Furthermore, the programmer has access tc all 
components of a freme including lin’xs to module continuation 
points, bound variables and free variable environments. 

The CONNIVFE analog to the PLAr'iMS?, consequent theorem is 
the IF-NESDEr demon, for CLIS? it is tne combination of the 
'is' and 'cases' commands, where 'is' directs the data base 
search and 'cases' performs pattern directed ‘=xeruticr. 
Likewise PGPIF?. offer similar features in tne form of the 
'achieve' and 'infer' commands which ar“ eacn a ^crm of 
consequent theorems. 'Achieve' will attempt to assert a 
specified goal whereas 'infer' will merely cneck the status 
of a specified goal, iasicaily, all these mechanisms provide 
a capability to "deduce desired logical , expressions from 
previously specified expressions in a manner similar to th<= 
deducton of theorems from axioms in theorem-proving programs 
U]. 

In keeping with the philosophy that "use of control 
structures better suited to a programming task can simplify 
that task and expose the significant problems in that 
problem," a variety of control structures for AI prcgramrirg 
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languaeres suited to a variety of AI tasks rave deen 
developed and refined continuously since tde cont ritutions 
of IPL and COr^IT were made [2lJ . 

The remainder of the chapter describes many of the new 
structures employed in AI programming, and discusses their 
implementations in the AI lanp'ua^es. The following 
structures ard concepts are included: Tata-driven 

profframmin.'?, demons, coroutines, procedural networks, 
chaining, backtracking, deduction systems, pat tern-di re''ted 
invocation, and discrimination networks. Some miscellaneous 
terms and concepts are defined at the end of tn^ chapter. 

A. DATA-DRIVEN RROGEAr^vl NG ( DISPATC^'ING 1 

Data-driven programming is a style of 
programming’ in which the boundary be- 
tween programs and data becomes even 
more blurred than usual [64] . 

Data-driven programminer is a method of attaching 
programs to data, thereby relieving the programmer of the 
detail of . predetermining much of the program control. T’’'- 
incoming data actually takes control by causing invocation 
of pre-specif ied , data-type dependent routines for 

application and execution [3J . 

This may be done by supplying a calling procedure with 
the user or argument input data that nas teen associated 
with procedures in the data base. This causes these 
procedures to be invoked and executed [51]. In particular. 
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in IIS? tills is done ’oy storing type specific fur-^tions in 
the forF of lAyrlA expressions on the property lists of 
type-desc rihing atorns. These functions are then 
autorratically fetched later when an ar?urent of a ^?iven type 
appears . 

A simple example may be contrived to dem; ons t rate the 
idea of attaching programs to data. Consider th‘= situation 
in which one would like to assert tne relationship 
CCMFONiNTS ( finger , handi 5) or COUS I MS ( m a ry , bob ^ . In order 
to do so, a general purpose procedure 'store', with its 
arguments, must be called. This procedure will allow the 
programmer to assert different relations, each type of which 
may very well requirp a different method of storage into the 
data base. For example the 'components' relation may use a 
hashing scheme, whereas the 'cousins' relation may be pushed 
onto a stack. In any case, there mi^ht be several different 
types of relations that are asserted at various tirr^s. It is 
highly desirable then to have a fi*eneral function, in this 
case 'store', that would take as argumpnts the relation and 
its ar^ruments. This function would then proceed to look on 
the property list of that relation to find and ptecute the 
associated storing function. In a situation su-'h as this the 
general function (e.g., stored is said to "dispatch" to 
(i.e., send off or away with promptness' procedures 
associated with relation names. 

A benefit of data-driven programming is that program 
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surgery is avoided whenever additional inforration is rpade 
available to the system [64j . If a new relation were created 
or an old one altered in the example it would te tahen care 
of via property lists and the program code need never te 
changed. Furthermore, it is a necessity for the 
implementation of pattern directed invocation and demons 
tnat are invoiced on the basis of recognition of a 

pre-speci f led data type [51]. 

2 . 

The idea of a demon is well-<cncwn in many other 
programming areas besides f.I, e.g., operating systems 
development. A lemon is a procedure that is automatically 
invoiced when a pres-pecif ied event takes place, such as a 
rendition becoming true, a certain value being cnanged, or 

some relation being altered in a certain way [?2j . "^ost 

commonly they are invoked by data base additions or 

removals . Activation occurs with a successful mat cn be twee n 
a data item and a pattern associated with a demon [c4l . 
Frames are in essence a demon-based seneme. i frame may 
provide the capability of a demon by containin^» a pattern 
that invokes a certain procedure. Programming languages tnat 
offer demon-like facilities include PLANf'.FR , CONMVPP, 
CUSP, and TEIOS. 

In CUSP, tne programmer is allowed sufficiert 
flexibility to design an efficient system in which a demon 



72 



is activated only at appropriate times, or a mere carefre® 
system wherein the demon is invoiced at every opportunity 
[4]. Groups of functions may he defined to act as "teams' of 
demons that may he associated with an arbitrary database 
storage or retrieval command. 

In PlANi\3?., there are the antecedent and consequent 
theorems. The former are, in effect, demons that act 
independently to add and delete facts to the data base as 
other facts arrive. An antecedent theorem or demon 

represents a fact in the form of: pattern (p) and body fb'. 
Whenever anything is asserted (entered into the data bas«l 
all antecedent theorems a re cnecked aga ins t the data tas®. 
If the recent assertion matches the p part then the b part 
is immediately executed. Consequent theorems, on the other 
hand, are not really demons but rather "fact-finders.” They 
are deductive mechanisms used to establish facts that are 
cemparat ively unim^-ortant and that by not having 
asserted do not clutter the data base. Their information is 
easily deriva^'le. Similarly, COWNIVS?. r.as IJ-NTTTSl! and 
ir-ADDSE demons that are analo^?ous to FLANNZ?/s consequent 
and antecedent theorems. 

In T3I0S , the use of demons occurs "in a clearly 
demarcated textual scope." A demon-like event mecnanism is 
used to allow the programmer to detect and trap error 
conditions and, if desired, to limit the effects of tneir 
scope during execution [59]. 
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Demons ^re used. amonc' otner places, in siorv 
ucders tandip-e programs tnat attempt to mame inferences vnile 
reading. For example, a demon with the pattern "person ? is 
outside" could contain in its body the fact: 

If it is (or will be) raining and F is outside 
then ? will get wet. 

■y’hile readin#^, the program may come across the sentences: 

It was raining. Jacic was outside. 

The first sentence would lihely invoke a routine ^called a 
base routine or hign level demon) about rain that alerts all 
demons related to that topic. The next sentence would then 
invoke the specific demon described above. 

An example of a simple demon in CONNIFE?. that is invoked 
whenever person ? loses his or ner job may be defined to 
alter the content of the data base in the following manner: 

DEFINE DSyON 
IF-ADBED 
(? LOSES :Or) 

(Femove '? is-a Eappy Person) 

(Add 'F is-a Sad Person) 

(Add '? has-no Steady Income) 

(Add 'P pays-no Income Taxes) 

END DEFINITION 



74 



Statements may be added at tde end to na\’’e the aenon 
deactivate itseli’ wnen it is throu^n or no longer needed. 

Temons are very useful as t.dey "add knowledge to a system 
without specification of where it will be used [64]." They 
are easily attached and encapsulate the bookkeeping 
operations that otherwise litter programs. Thus, programs 
are more readable. 

C. C0P.0UTIM5? 

Coroutines are "specialized control mechanisms for 
situations in which the natural division of a process into 
subtasks is not hierarchical [21]." Three prccram stnjctnres 
that are analogous to coroutines, and s^^rv® to d^mcnstra ♦■e 
their appropriateness are: I'^^utual subroutines, a 
simplistic point of view wherein each of several procedures 
are to be written so that each procedure ray call the others 
as if the others were subroutines, ‘’)The '^ost characteristic 
perspective of coroutines is that of procedures with 'own^ 
storage such that a procedure's variables retain tneir 
values between calls. The 'own' variables retai" not only 
local procedure data, but also the state of processing 
within the procedure so that processing will continue from 
tnat point at tne next invocation, and Symmetrical 
control achieved by separatine- proo'rars intc los'ically 
disjoint parts and describing each part separately. 'I’neir 
various stages of execution are then interleaved [21]. Ihis 



idst view may be considered more as a side-effect of tne 
implementation of a coroutine regime tnan analogy. 
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eiplicit call, and txie routine wnich is called is resumed at 
tne point from which it last left off, with all of its 
internal variables unchanged, that is, the previous state is 
restored [52] . 

The advantage of using coroutines is that eacn of 
several processes can be described as a main routine (vs. 
subroutine) with minimal concern for tre interface witr. 
other processes [21], k coroutine may be given more than one 
continuation point and use only one of tnerr depending on the 
result of some t<=st [?] . 

A simple example would be provducer-consumer situation 
involving two routines A and 5. Routine a ' s Job is to 
a data base for a certain type of expression or datum. '"'h^^n 
it has found one not previously ^ound it fetches it, leaves 
it in a certain location, suspends itself and resi.mes tne 
processing of routine 5. Routine B's job is to f®Tch from a 
certain location an expression on which it is to perform 
some computation. Oncp tnis is dene it suspends itself and 
resumes processing of routine A. Routine A continues wnere 
it left off in its data base searen and fet^'h. Tnis back and 
forth processing continues until A can no longer fine 
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expressions cr until S has perfom<=(i a pr°-speci f ied amount 
of coinputa t ion , zoih routines in this situation operate as 
thou^;h each were a main routine. 

In T2IQS , there is a mechanism (function' called 
MewProcess which provides a coroutine capability. N'ewProcess 
creates a coroutine as a process with specified actual 
parameters. The value returned by NewProcess is a reference 
to the newly created process. The state in whi^'h the new- 
process begins execution will be that which was operative 
when NewProcess was executed [59] . 

In CONNIVSR, there are ’’generators" which are a kind of 
coroutine process. A generator will venerate requested data 
items, one or a few at a tine, to which some specified 
process will be applied. The environments of the process and 
the generator are independent and not ni erarchi cally 
defined. If more data items are later requested, the 
generator resumes in the data context of the previous 
request. An analogy would be a PORZACK statement wherein, 
the head would represent the generator and the touv of the 
statement would represent the spe''ified prf'cess. Rut. 
imagine that that particular tody may be interchanged with 
another body perhaps of another P3RSACH statement in another 
data context. Then execution would continue in different 
data and control contexts for the Two parts. 

SAIL also provides a limited coroutine ca_i.abi 1 i ty . Vith 
the use of a command called SPROUT a new process may be 
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created to corr^ence execution at tne point it is created and 
run parallel to the process that executed tne cotrmard. True 
parallelism is not possicle on a single processor computer 
so the SAIL run time system includes a scneduler that 
supervises the multiprocessing regime by deciding which 
process is to be executed at a given instant. Processes can 
contain instructions to suspend or terminate them.selves or 
other processes. Tne RESUME com.mand will suspend the current 
process and reactivate a named suspended process. Eut, no 
capability exists for one process to pass any informiation to 
another except via side effects. 

D. PROCEDURAL NETWORKS 

Procedural nets are usually used for representing plans 
created by problem-solving systems. A problem-solver such as 
STRIPS (see Appendix P) will ^renerate hierarchical plans 
beginning at the highest level of abstraction of tne goal 
state to be achieved until a sufficiently detailed level is 
reached tc allow execution. 

Tne simplest possible procedural net consists of a 
sinp-le node with two directed arcs, one leading in and one 
leading outi this would specify the single step in a 
one-step plan. 
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A refined procedural cet describing a prctler 
reconf ip’urinr arraaeiefrent; i lo set a r ran^-erren t 
below. In the problem» only 1 letter may be moved 
of one space in any direction that an empty space 



involving 
2 is shown 
a distance 
exists. 



arrangement 1: 
INPUT 0HU2R(A r C) 









A 




c 



arrangement 2r 
C-CAI CHI2P(P C A I 
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On more complex nets the nodes are the steps or actions to 
be taken, whereas the edges (directed arcs) irnly the 
setiuencing of the steps. 

An important feature of procedural nets is that wnen a 
plan is srenerated it is often unclear what will be the best 
order to carry out some of the steps. Tne order is allowed 
to be left unspecified until some later time when the 
correct ordering does become clear [23j . This may not take 
place till the plan is actually executed. Lanp-uames which 
allow this type of feature include PIANNEP, COMuITIP, CII??. 
and PROLOG. 
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CH.UNING 



Tnere are two types of cnaininp: forward and tac’tward. 
If the goal of a search is to discover all that can te 
deduced from a sriven set of facts then forward chainin,? is 
appropriate. Progress is made as the system wor’js from and 
initial state toward a g-oal state. The shape of the state 
space is fan-in. Figure 4a. is an example of such a space. 

A forward chaining technique (means-end analysis) is 
employed in GPS (see A.ppendix E). At the start tnere are a 
number of differences existin? between the initial state and 
goal state. At each point GPS selects what it figures to te 
the most prominant difference and attempts to eliminate it 
[64]. 




initial 

states 




Forward Chaining 
(Fan-In ) 
Figure 4a 



Packward Chaining 
(Fan-Cut ) 
Figure 4t 
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Backward chainiUe;* works in just tie opposite manner. 
First of all, tie snape of tne state space is f an—^ut , as in 
figure 41:t. The goal is to verify or deny a particular 
conclusion. Thus, promression is from the eoal state toward 
the initial state. Often backward chaining will lead to dead 
ends, i . e . , suhs-oa 1 s which cannot he deduced from information 
available in the database. In that case, a return to the 
state that induced the subeoal takes place and a new sub^oal 
is selected, if one eTists[64j. 

Backward chaining techniques are employed in rule-based 
systems [27j such as MYCIM and LECAIFS, in ?IA I'lMBB -1 ike 
lan^uaee systems, and in theorem-proving' systems, su-'h as 
BUILD and HACTEB (see Appendix 5) 

F. NONDETEHMINISM and lACKTHACKINO 

These two programming concepts go hanc-i n-hanc . 
Backtracking is usually applied to nondeterrinisti ^ 
programs. A nondetermi ni s ti c program is one that mav have 
its solution spa^e represented as a search tr=e, wn^r-^ “acn 
terminal node is a potential solution. Tne task is to 
traverse tne tree starting at tne root node, and find a 
solution node [21] . 

Backtracking is basically an exhaustive depth-first 
search procedure. Tne algorithm to traverse the tree is 
executed, making choices at earn node regarding wnat path 
take next accordin,? to some choice function, '/hen a solution 
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node turns out to be a failure, tne al^oritnm bacirs up , 
restoring all variable values to tne last cbclce point at 
wni on one or more feasible choices remain, indicating 
alternative paths [21] . 

Backtracking has teen considered as a special coroutine 
regime (in the sense tnat a coroutine is characterized by 
the ability to suspend a processinsr state of a routine that 
may then be resumed at a later time where it left off). 
Instances of the program environment (called modules) are 
saved at the choice points, and restored in a LI70 sequence 
when subsequent modules "fail" [4]. 

In PLANNER, a nondeterminist ic langua£-e, backtrackinr is 
provided completely automatically. The advantages of this 
are that the programmer does not have to wor^y about writing 
such a complex search strategy, and the program text becomes 
relatively easy to read. However, this latter advantage can 
turn into a disadvantage when tne programmer is urable to 
infer from the text precisely what is happeninp . Por 
example, a typical task for the SHRTLU problem-solver ^S'=' = 
Appendix S') written in Hi cro-PLANNHR , a subset of PLANNZF, 
could be to "locate the big, blue block, or the small 
pyramid shaped one." SFREL’J would have tc set up the 
following three goals: 

1. Look for a block. 

2. Check to see if it is blue or pyramid snaped. 

3. Check the size. 
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If the blcc’i is blue the prograrri will proceed to determine 
if it big. If not, it will bac’t up to the previous decision 
point to see perhaps if it pyramidal. If it is, it will 
check the size again since the result of the previous checl: 
is unavailable now. If the test fails again the program will 
backtrack again to get another block this time, backtracking 
must be used nere as tnere is no wav to determine in advance 
which block, B1 , 22, 23, etc. is the ore which will have the 
three properties. This tends to encourage the construction 
of programs that rely too heavily on b^li nd search. An 
additional disadvantage of automatic backtracking in rlANNFH 
is that there is no way to determine why a particular 
failure occurred, as the environmental context at the point 
of failure is deleted[5j. 

The development of C0NMVT2 was an attempt to retain all 
of PLANN2P. 's good features and replace the baa ores, namely 
tha t of au t oma t i c backt racki n? . C0i\M VTR provides a 
capability for a failed routine not only to tell a r. irner 
level module why it failed but to pv^n pass cn information 
about the successive world changes it encountered along the 
way [5]. The power of this facility allows systems to ’■e 
implemented in CONNIVEF that attempt to learn from their 
mistakes. This is not possible with . The 
problem-solving systems HACKSF (written in CC‘^il\'I VEF ' and 
3KRDLU (written in FLANN3H) are examples of this difference 
fsee Appendix 2). 
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PROLOG- provides for a bacJstrac'cing capability. Since 
PROLOG is a predicate logic-based system, it searches or 
tries to deduce a clause to mated a goal clause. When it 
fails and rejects a clause the original goal clause is 
reconsidered and an attempt is made to find a subsequent 
clause which also matches the goal [59] . 

G. PRODUCTION RULES and DEDUCTION SYSTEMS 

Production riiles, as tuey occur in deduction systems, 
are general statements in the form of' implications, which 
the system uses to deduce new or implicit '-rnowledge. 
Conceptually a rule would have the format 
antecedent => consequent. 

The antecedent part of a rule (Ids: lef t-nand-side ) 

represents a set of assumptions or conditions, and the 
consequent part (rns: right-hand-side), a set of goals or 
actions [ET] . Thus, the control structure amiounts to a 
simple "recogni ze-act” paradigm. 

Each rule is designed to be ideally, 
an independent enunk of knowledge 
with its own statements of relevance 
(either the conditions of the Ids, 
as in a data- driven system, or the 
action of an rhs, as in a 
goal-directed system [1£] . 

The significance of the production rules is revealed 
when they are considered together with a data base of fa^ts 
and an interpreter for the rules. With this combination, a 



deduction system may b=> cons tru^' ted . For example, the 
deduction system below called DS.CV has two productions, EFl 
and rS2, and one fact, FI, also found in the data base. 

ES.CV: (CSl, ES2) 

DSl: ((car is FIAT) and (type is Sportscar) => 

(car is Spyder)) 

DS2: ((make is Foreign) and (size is Small) => 

(car i s Sportscar) ) 

Fl : FIAT is foreign-made. 

Given that we have a small FIAT, we would li'/e to 
determine if it is a Spyder. This can be done by applying 
the rules and the farts in the followina- manner: 



Apply Fl => foreign-made 
2) Apply ES2 => car is a Sportscar 

3' Apply ESI => Spyder (which was what we wanted K 
This graphs into: 




Any conclusion is usually derived from many productions. 
The A conclusion in an individual production follows from a. 
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conjuaction of the facts, all asserted to he trae, ia the 
antecedent part. A conclusion reacned ty more taan one 
production is done so through tne disjunction of those 
productions. This translates into an And/Cr tree 
representation of the productions and conclusions. ?i^ure 3c 
is an example of such a representation. 

forking from kncvn facts to new, or deduced facts (as in 
the above example) utilizes forward-chaining. However, a 
deduction system can also employ ha cV:wa rd-chai ni US’ hy 
hypothesizing a conclusion and using tne productions to work 
backward toward an assertion of all the facts necessary to 
support the hypothesis [64]. 

The advantages of deduction svstems include: 

I'They seem to provide a decent mo iel of human 
problem-solving behavior. Humans informally deduce 
much from their own observations, e>'pe rien''es and 
education . 

2 'The knowledge base provided by all th“ 
productions may srow incrementally with the sirplp* 
addition of new productions. 

3 )Da ta-driven programming is induced. Thus, a 
piece of knowledge (that is, proceaure) nay be 
applied whenever it is appropriate without having 
to have been planned for ahead of time. 

The Second advantage can become more a problem if the 
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frowtJi of the ’cnowiedrre tase is allowed to i:et unreas onal I 7 
out of hounds. A way tc prevent this is to partition the 
facts and productions into subsystems (based on some 

relationship) so that at any e^iven time only a manageable 
number are available. 

PIANNEK, GOMNIVZ^, and POPIZ?. are nicely suited for 
implementation of a deduction system. PLANNER provides 
consequent theorems, C0NNIV3H offers IF-NEEE2L demons, and, 
PCPLSH has a co ndi ti on-c onsequen t conditional. All are 
analogous to the "si tua ti cn='>ac t ion"- typa production needed 
to represent )cnowledge in the data base. Also. PLANNER'S 
antecedent theorem and CONNIVE? 's IP-ALPSE demon will add 
and delete facts from the data base as new facts ar“ 
introduced . 

Deduction system.s are being «ell-exploi ted for the 
development of -cno wlede-e-based expert systems «’e.e‘., *^TCIN. 
DSNDP.AI, DECAIES, CHTSAIIS, and PROSPECTOR, see ipn^ndix P ) , 
where formal and informal knowledge of the domain, and even 
the way the expert tnirrcs in that domain f = .g., is 

Crystallized into a set of production rules [ICj. 
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H. PATTTSRN-DIRSCTED INVOCATION and fiSTRIEVAL 

Fai:tern-directed invocation of functions ana 
pattern-directed data retrieval are deductive techniques 
tnat nave recently tecorne quite popular ana for some tasks 
absolutely necessary. The phrase "pattern-directed 
invocation is somewhat self-explanatory. It refers to the 
method of invoking procedures indirectly, i.e., based on a 
pattern match, rather than an explicit call to a location. 
The match takes place between the desired output and and a 
procedure header, pattern-directed data retrieval is based 
on a similar notion. Cne night retrieve an ass^=rtion Cfacr) 
f^om the data base by matc.ning a yatterr containing the 
known components and their order against all the asserticns 
in the data base. In this manner large stores cf symbolic 
data may be manipulated efficiently. 

The essence of these techniques is a pat tern-matc’r i '? 
algorithm which will perform symbolic ®rpressirn 
comparisons ,atcm-by-a tom. It will allow an expression to ''p 
specified as a template against data items, in the cas'= 
data retrieval. An example of this idea ray be taken from 
C0NMr’'i?, whose pattern matcner may be used cr er'^itrarv 
LIS? data. It is desired to fetch items from the data base 
that match tne pattern (template): 



Tiie a’orvo template is found tc rratcn fcotii 

( fEUEIlKA HU'yEOIIT' GOU'^ITY ^ end 
((Z'lP.SKA I '73 ) FD’JiMD IT). 



generating t-^e association lists 

((I H3M30LDT) (H3ST (COUNTTM) and 
((7 I '73) (^EST (30’]N3 IT))^ 

wnere I and REST are specified as open pattern variables. 
They are so indicated by the prefix In general pattern 

variable must have type declarations wnich are done via 
special prefix symbols [4] . 



Templates provide a very flexible 
and easily understood way tc specify 
the form of data items required, 
without the user having to be aware 
of how the items are stored [4]. 

In the case of subroutine sele-rtion. a template is 
specified as part of the definition of eacn subroutine. The 
subroutine will be executed if its template rat-'h^s t'^e 
actual arguments of the expression that invoked it. En 
example from [4] demonstrates this idea. Consider t'^e 
following two functions, PI'JSSI^iGLS and rLUfhZpo, wnicn 
mifiiht be part of an algebraic simplifier. 



?^TSSI^iC-IE : (0IAM3DA fPL'JS Xs ^ 

PLUSZ3R0 : (CLAMEDA (PLUS £ d-d-XJ 
('(PLUS ^$X))). 
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The single arrow prefix (<-} indicates tdat a single 
argument is to matched. A doutle arrow prefix on a 
pattern variable indicates taat any number of arguments will 
be accepted but considered as a single entity. PLUSSINGL2 
will, given any form of PLUS followed by any single element, 
return that single elem.ent. PLUSZSPO presented with any form 
of PIUS followed by any number of elements, one of which is 
G,will return the form PLUS followed by all the other 
elements of th“ argument [47J . 

Punctions invoiced by patterns are typically defined for 
an application toward a specified purpose. Some functions 
are used for consequent reasoning, and some for antecedent 
reasoning. In the first case, a function Consequent 
reasoning is required when trying to uetermine the truth cf 
as assertion not explicitly represented in tne data base. 
Some consequent procedure would be invoked by a successful 
match of the assertion in questionto a pattern that 
indicates the type of assertion proven true by a successful 
execution of the bony of the procedure. On the other nard, 
antecedent reasoning! is used when a program attempts to 
cause effects on tne aata base [47]. Thus, consequent 
functions are tried wnen a ^oal is desired and ante''eient 
functions when the data base is to be updated. This allows a 
top-level program to invoke a subroutine to produce a 
certain data structure, witnout having to know whi^h 
subroutine will respond to the request [4]. 
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Pctiern variatles are special variatles used in a 
pattern specification or template to indicate wnat the 
context or binding of the variable must be in order to make 
it eligible for a match. In general, a pattern variable is 
typed as being "open" or "closed". An open variable will 
match anytning whereas a closed variable will match only an 
item equal to the previous ly assigned ty pe-v alue of the 
variable. Although PLAMNER and CONNIVE?, have no closi=d 
pattern variable, they, like QIIS? and INTERIIS? (whi-’h do 
have a closed pattern variable type ), provide a semi-op®n 
type. It will match any item, if it has not teen previously 
matched , 0 therwise it will match the previously assigned one. 
Thus, it acts as an open variable tne first tine and a 
closed variable thereafter. I’^stead of a semi-open pattern 
variable, CONNIVE? has a type "macro". The macro has two 
values, one which instructs substitution of a CONiNIVT? value 
and anotner to substitute the LIS? value in the te'"plate 
[4]. FOPIE? offers the greatest variety; four typps, rv;o 
modes, and restrictions for any of the types. The 
restrictions are in terms of data type or some 
user-specified tests. The variable types include cne closed, 
one semi-open and two types of open. Cne tnat jjS rrra r.ent ly 
assigns values and another that temporarily assigns a value, 
setting up a failure-action to restore th= old value. 

In addition to CONNIVE?, PLANNE?. CLISP, and INTEPIIS?, 
the languages SAIL, TSLOS , and PROLOG also possess pattern 
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matching facility. In SAIL, the n-echanism is lirrited sines a 
template is simply created ty specifying* one or more items 

of an association. A search on the data base then occurs in 

order to find all tne associations whose items match tne 

specified items in the template. For example, the 

association 

MONTEREY - = . 

could be provided as a template. All the triples in the data 
base with i teml = MONTERS'^ would be returned as matches, and 
each triple would be executed in turn. 

In TELO*^ , as well as SAIL, the primary use of patterns 
is in associative referencing. For instance, tne instruction 

GET(person[ ? age rgreater {ZV) ? ]) 

' can serve as a template for retrieving a data base itei^, 
where the "f'rea ter"is a pattern function [59]. 

In PROLOG, there is a facility called "un i f 1 ca t i cn" which 
is explained as "pattern matching + logical variable [62] " . 
1977]. A logical variable is distinguished by tne fact that 
it is unprefixed. That is, there is no distinction made by 
the programmer as to whether it is open, clo<:e, sem:i-open, 
etc. The programmer need never be concerned wit^ whether it 
is assigned or bound or not. '^he system manages tnat aspect. 
To execute a ?oal, the system searches for the ^‘irst clause 
(recall that P'^OLOG is a predicate logic based language) 
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wnose head (i.e., procedure entry point) ire ten es or 
"unifies" with the ^oal. The process of unification then 
finds the rost .general common instance of the two terms. If 
a match is found the found-clause is activated hy executing 
in turn each of the goals within its body. Absence of a 
ma.tch causes hacjctiadcine to occur to the point that the 
original goal may be reconsidered and an attempt made to 

find a subsequent clause that also matches the goal [62] . 

CUSP also offers a "unification" mechanism for pattern 
matching. It does not have the same effect as that of 
PFOLOG, however. In CUSP, this mechanism will let each of 
two expressions act as templates for one anctner. The 
facility is invoked by the keyword i‘-‘ATCECC. An example of 
its usage may be shown as follows: 

MATCEOC (A (£ <-T) <-Y)( <-X <-Z (A (£ O'). 

Here X, T, and Z are open variables. The effect produced is 
that X is matched to A, Y to (A (3 C)) and Z to fP A). 



I. DISCRIi'^LVATIDM NETWOPE 

A discrimination net classifies information on the tasis 
of some of its properties. It is a tree-like structure in 
which the nodes represent tests to apply to an expression 
and tne arcs represent values returned ty the tests. These 
tests can then be set up to find out if some specifiei fa^t 
(in the form of a list of atoms or an arbitrary expression) 
is stored in the data base [9] . 

In vLiSP, a discrimination net is used to represent the 
form of. a data base. All data is stored in a common net so 
that equivalent expressions may be represented uniauely. 
Only one instance of an expression .rray occur, so. before an 
expression is entered into the data base it is transformed 
into a canonical form [47]. This enables an expression in 
the net to possess a permanent property list just lik» that 
of a IISP atom [4]. Per example, the d i scrimi ra ti cr net in 
figure ^c contains the expression USE (dinkshot'* whi^h wculd 
possess a property list that inclur^es the ’"‘ollcwing 
information : 



loca t ior 


Frontside 


Shot Length 


Short 


Type of Return 


Def ens i ve 
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Is shot down 
center of court? 




I 

P.oom for 
backs wins'? 




use use 
smash ceiling 



Opponent 
.ef thanded? 




use r t 
CO rner 



use 

left 



Opponen t 
backcou rt? 





use use use use 

dink kill pass cei lies' 



Discrimination Net'work. 
Difure 4c 
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DEPINITIONS FOR CONTROL STRUCTURES 



1 . Recursion 



A recursive technique is one with an 
essentially hierarchical character, that can 
be naturally described in several levels of 
detail. And a recursive procedure is one that 
can refer to and operate on itself, so that 
it can be "nested" within itself to an 
indefinite nunber of hierarchical levels [5] . 



The factorial routine below is an example of a recursive 
subroutine . 

SUBROUTINE FACTORIAL (N) 

FACTORIAL 1=1 

IF N > 1, FACTORIAL N = N - FACTORIAL (N-l) 

END SUBROUTINE 

Using iteration instead of recursion this routine would 

appear somewhat longer and more awicward to read and write: 

SUBROUTINE FACTORIAL (N) 

FACTORIAL = 1 
IF N <= 1 TEEN X: 

FOR I = 2 TO N 
FACTORIAL = FACTORIAL - I 
NEXT I 
X: RETURN 
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2. Unification and Instantiation 



Unification attempts to find substitutions of terms 
for varables to make expressions (well-formed formulas) 
identical . 



Very briefly and according to [39], a well-formed 
formula (wff) is any legitimate expression of the 
predicate calculus. For example, 

ON (BOAT, LAKE) 

ON(x, y). 

The elementary components of predicate calculus 
are: l)predicate symbol s-represents a relation in 
a domain of discourse, e.g., ON. 

2) variable symbol s-permi ts one to be indefinite 
about which entity is bein? referred to, e .e . , x 
and y . 

3) function symbols-denote functions in the domain 
of discourse. For example in^the statement "The 
fast car beat the slow car’ which may be 
represented by the expression BEAT ( fas t ( CAR ) , 
slow(CAR)), fast and slow are the fun'^ticn 
symbols . 

4) constant symbols-simple term used to represent a 
physical object or entity in the domain of 
discourse, e.g., BOAT, LAKE. 

The wffs above are atomic. More complex wf^s may 
be formed with connectives such as (and), V (or), 

=> (implies). Example: ON (BOAT, LAKE) 

IN (FISHERMAN, WATER). 

Any wff, atomic or complex, will evaluate to a 
true or false value. 

With regard to unification, wff ¥2 may be obtained from the 
wffs of the form W1 and Wl=>W2 via Modus Ponens inference 
rule. Furthermore, the universal specialization rule of 
inference allows the wff W(A) to be derived from the wff 
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(Vx) W(x), where A is any constant symbol. Usinsr the two 
rules togetner produces tne wff W2(^) from the wffe 
( Vi ) [¥1 ( I ) =>W2 ( x) ] and W1(A). Thus unification is reo.uired 
to find tne substitution "a for i" that makes the 
well-formed formulas W1(A) and 'rfl(x) identical [39]. There 
are two reasons for performing unification: 



1. Resolution. If the two atoms that were 
unified (made identical) occur in different 
clauses and with opposite "signs’’ (one 
positive, one negative), then tne clauses in 
which the two occur can be resolved. 

2. Factorine. If the two atoms that were 
unified occur in the same clause with the 
same sicn, then the clause contains two 
identical literals. The duplicate^li teral can 
be eliminated. This is called "factoring”, 
and thp clause with the substitutions made 
and the duplicate literal eliminated is a 
"factor" of the original clause [23j . 



Instantiation occurs when the name of a particular 
individual or object is substituted for a variable. The 
individual is then an "instance" of the variable. 
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3 . Predicate logic 



Predicate lo^ic breaks up propositional clauses 
(statements) in order to consider individually the items 
about which something is beins asserted. For example t the 
propos i t ion , 

"the frog is in the water" 

would be dealt with as one statement or entity in 
propositional logic, about which one would assert its truth 
or falsity. This statement however contains two items from 
the real world, namely "the frog" and "the water." The 
relationship between the two is expressed by the words "is 
in." The phrase "is in" may be represented by IN and is 
considered the predicate. The individuals, "the frog" (FP.GG) 
and "the water" (WATER) are the arguments for the predicate. 
Thus, the original proposition may be restated in the 
following way: 

IN (FROG, WATER) 



Any of the operations of propositional logic may still be 
applied to the statement. 

The power that predicate logic adds is in the fact 



that the arguments of 


the 


predi ca te 


need not be 


narr.ed 


explicitly (instantia 


ted) . 


They may 


be variables, 


i *e • , 


IN(i, y), a much more 


general statement yielding a 


Tore 



general and flexible reasoning capability [23j . 
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Resolution Logic 



TUe tasic idea of tne resolution principle is to 
prove the the converse of a theorem is false. Thus, 
resolution is a method for proving that a false statement os 
indeed false, hut not necessarily that a true statement is 
true. Nevertheless, the advantage of this method is that if 
a theorem is true, a proof will he produced after a finite 
number of steps [26] . The fundamental technique employed is 
the conversion of an implication to an expression that 
contains no implication. That is, if 'p implies q' then it 
is eqivalent to state 'not p or q.' 

Given a set of premises, the procedure for deriving 
a conclusion is as follows: 

1. Form a new set of premises from the giver, 
premises and a negation of the conclusion. 

2. Derive a contradiction from this new set. 

3. Assumption of the original premises to he true 
and the derived conclusion to he false leads to a 
contradiction, therefore the desirea conclusion 
must he true whenever the premises ar true. Tnus 
the desired conclusion follows from the premises 
[23] . 

In general, resolution is more easily programmed 
than the other computational logics. It can handle complex 
premises and conclusions. However, because of combinatorial 
explosion it can't he used to prove deep mathematical 
theorems verifying complex, computer programs or to aid a 
robot cope with real world complexities. This is a result of 
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tne need derive many clauses (tnrougft unification, 
resolution and factoring) that are relevant tc deriving a 
conclusion. A great deal of time is wasted though following 
lines of reasoning that come to dead ends [23] . 

Resolution can he used as the logical mechanism for 
theorem-provers . It has also been used in natural language 
understanding systems, formula manipulation and symbolic 
integration systems, and STRIFS-style problem-solvers. 

One language especially well-suited for resolution 
programming is PROLOG [ 60 ] . 



Sumnary Ciiarr of AI Ldn.-:uaees and Tneir 
Data and Control Structures 



LANGUAGE : 


DATA STP.UCTUR3: 


CCNTPCL STrfJCTUHP: 


T T'T- 

i rxj 


list 


Sequential 


ccrir 


S trinff 


Sequential 


LISP 


List 


Hierarchical 




property lists 


recursion 


INTSPLISP 


Same as LISP 


as in LISP plus 




plus strings, 


pattern matching:.' a 




arrays, and user 


f rame-orient'=d 


1 


defined data types 


control 


QIISP 


sane as above 


sane as above plus 




plus tuples, 
ta^TS , classes, 
and vectors, 
discrimination 
net data base 


lemons 


PIAMNS” 


List, data base 


global bacht rac>i 




made of assertions 


pattern matchin&, 




and antecedent and 


lemons 




consequent theorems 


recursion 



IZ'2 



i 



CONNIVSH 


List, If-addea , 


pattern natcnin^?. 




If-needed theorems 


demons , 




in a context 


coroutine capabilitv 




oriented data "base 


recursion 


LiA? 


Sets, associative 
data "base, pro- 
perty lists 


pattern matching 


SAIL 


same as LEA? plus 


pattern mat chine. 




non-recursive list 


coroutine capability 




s tructure 


recursion 


-r OF LEK. 


List, context- 


pattern matching' 




oriented data base 
with FLAf'JNE'x-li'xe 
t heo rems 


recursion 


PP.OLOG 


List, record. 


pattern matching, 




frame, assert- 


backtraciting: 




ional data base 


recursion 


AFSS7 


Sets 




TSLOS 


as in PASCAL plus 


pattern matching. 




encapsulated data 


coroutine capability 




s tructuri n^ 


demons, recursicn 
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VI. CC:>iCLUS ICNS 



Artificial Intelligence is the use 
of programs as tools in the study of 
intelligent processes, tools that helo 
in the discovery of the 
thinlring-procedures and epistemological 
structures employed hy intelligent 
crea ture s [5] . 

This statement is generally representative of the 
feelin^rs of many AI researchers. The role of pro^ramminfi- 
languages in AI is an undeniably major one. Moreover, the 
requirements of A I are complex, am)bitious, and demaridinfr to 
the point that general purpose conventional languages are 
inadequate. In fact, it is likely that data representation 
techniques or control structures invented for today's AI 
needs will inevitably be incorporated in conventional 
languages for more general purpose computing [22j . 

There is some mild difference of opinion as to the 
importance of data structures versus control structures. The 
argument is that the data structures needed in “rtificial 
Intelligence do not really differ from those needed in 
general. Thus the key to efficient processing really lies in 
the available control mechanisms of a programming lanf,ucte 
[22]. However, this statement becomes l“ss accurate as the 
distinction between aata structure and control structure 
becomes increasingly fuzzy. For instance, frames and 
contexts are considered as data structures in Chapter III. 
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The reasoning was tnat they can be consi'^erec. data entities 
with which are associated certain operations for their 
manipulation, e.g., create, delete, and modif?;. It may also 
be argued however that these are control structures. A frame 
slot for instance may cause the invocation of some procedure 
or the retrieval of another frame. Therefore in order to '^e 
tnorough in the coverage of the special features reouired 
for AI programming, data structures as well as control 
structures must be considered equally important, to the 
possible extent at times that their distinction ray seem 
entirely arbitrary. 

Without exception, the languages employed in AI are 
symbol manipulators, i^ore specifically, as mentioned 

earlier, they are either list processors or string 

processors (although a string may he manipulated as a linear 
list). The idea of a string processing language is becoming 
an obsolete one, as strict string manipulation is too 
restrictive for most applications. The current trend is to 
incorporate string processing capabilities in list 

processing languages. The notion of 'CTP-encoding ' was 
intended to achieve just that for LIS?. It implies that 
segments within a list will be stored in sequential 

locations in memory. Instead of the normal representation 
for a list, e.g., LIST(W X I 2): 




W X Y Z 
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it mie:nt loo’i sometninp li!ce: 



W X Y Z 

This would he nicely suited to records or packed data 
structures that are generally manipulated as wnole entities. 
The advantage is a substantial savings of storas-e as 
locations containing pointers to the nezt list item are no 
longer needed. This is the very advantage that string 
processing has always had over list processins [S] . 

By now, there can be little disagreement as to tne 
primacy of the list structure in AI programming. lata that 
is represented internally in a list structure conveniently 
allows for dynamic storage allocation, a basic necessity for 
AI computing, "’hose languages which don't provide it as a 
built-in feature provide ^ood facilities for allowing- the 
user to define such a data type as well as operations for 
its creation, deletion, and manipulation. Although list 
processing is a necessary capability for a good AI ian?si-a£’e 
to possess, there are other capabilities that should be 
considered highly desirable as well. The qualities listed 
below are seven of tne most important. 

1. Languages should be based on a single compiler or 
interpreter so that the basic control structures needed are 
easily accessed and AI systems may be developed by writing 
packs of procedures [22] . 
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CHS?, COJiNIVER, and PIANNEP. Tiust be iransHted into 
LISP as a halfvay stase. I'^ost systems written in these 
lan^uares have some modules or procedures written in LISP or 
INTPRLISP. In sore cases it is even necessary to write a 
special purpose language in order to do processing on a 
certain taslc efficiently (e.^., STP.IFS, S-priU, ^ee appendix 
3). The result is that most systems are implemented in 
INTSHLISP. 

2 , Languages should offer simple control structures as 
opposed to complex, elaborate ones [ 22 ]. 

Elaborate control structure can hinder as often as help 
the user not intimately familiar witn its rrarner of 
operation. The well-used example of p-lobal bacjctracicinp- in 
PLANiMSP. demonstrates this point. Its casi’.al u’sage by a naive 
programmer will lead to considerable inefficiency. 

3. The ways in which compli=x control structures ar= us^d 
should be studied to determine if more efficient 
implementations coula be designed into a language [22]. 

Por example, recursion is generally space consumptive 
and slow. It was discovered that many uses involve recursir^: 
an expression to ^^et a value that is then merely passed bacV 
up through the chain in which tne expressions themselves do 
not change. This is not an efficient use of recursion. 
Tail-recursion is a compromise between recursion and 
iteration, was invented to make recursion more '=f-^icient 
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under such circurrs tances . In a tail-recursion situation, 
recursion is used to compute a value, vhicn is tnen passed 
tack up the chain at which point the procedure can he 
converted to a simple iterative procedure. Tne value of this 
technicLue is in the sutstantial space (and time) savings, 
since tne intermediate activation records for eacn recursive 
step need not te saved. 

4. Garbage collection remains as one of tne most 
effective and simple metnods for reclaiming abandoned 
storage cells. 

5. The use and manipulation of patterns is beccning an 
increasingly important capability for variety of operations 
including data retrieval, procedure invocation, and 
unification. 

Currently the general pattern matcning operation reti’rns 
too little information. Timer a -“ailure is repcrt^t^ or a 
match is with no indication as to how close the "atcn rright 
have been in the case of failure. It would be useful to hav= 
a measure of "fuzzy' matcning for dealing with etpressions 
on a semantic level [47] . 

5. Eata storage and retrieval mechanisms should be 
incorporated that will not just distribute data randomly 
throughout the store [47] . 

I 
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would le useful to rfany applications to nave data 
stored on a semantic tas is rather than a syntactic one as is 
most oft<=n the case. That is, seme method of storing tha t 
considers some relation among some data items such that they 
are linked or stored in close proximity to one another. 

7. Facilities for user defined data types should te 
considered more desirable than a multitude of built-in types 
that may turn out to be insufficient for unanticipated 
needs . 

LIS? is one of the oldest high level programming 
languages, the second oldest in fact according to its 
inventor, John ^IcCarthy [ 04 ] (rORTF.AN being considered the 
oldest). It is also the most popular for AI programming. For 
no one particular reason, but rather a combinatior of 
several (including the rapid growth of AI researen), IIS? 
has become the AI programming standard. There nave been and 
still are many contenders for that position but so far none 
offer sufficient improvement over LlS?'s capabilities to 
warrant majority acceptance. The fact that LIS? gives good 
access to the features of the host machine and its operating 
system, the availability of its interpreter as a i^ommand 
languae-e for driving other programs, along with its internal 
list structure that makes it a good target for translating 
from yet higher level languages, make it a convenient 
vehicle for higher level systems for AI [34] . 
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LIS? possesses nearly all the qualities of a ?ood AI 
language that were listed above. It has tne distinction of 
having the first compiler written in the ian£jua^?e to he 
compiled [34j . The LISP interpreter is also written in LISP 
and is about one page in length. 

LISP has a small set of selector and constructor 
operations that are expressed as functions. Simplicity is 
derived from the small number of these functions. The fact 
that these operations were made into functions together with 
the ability to have branching within function definitions 
enabled LIS? to become an entirely applicative language. 
That is, everything in a LIS? program is presented as an 
expression. Separate procedures for function definition are 
not needed. There is no need for statements (such as goto's 
and assignments) of the type found in most languaa-ps. LIS? 
is based on the iaeas of the Lambda calculus. Conditional 
expressions may be recursively employed for buildin^^ 
computable functions. Programs f^ay be represented as data, 
and data as programs for that matter. These aspects 
contribute to the par.tial, but significant, achieve^-ient of 
one of 'IcCarthy's original design goals, that is, to provide 
the capability for programs to be proved correct. 

The availability of a property list structure, automatic 
garbage collection combined with features already mentioned 
(such as recursion and data-program irdistinguishability) 
have made LISP extremely well-suited to past AI programming 
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needs. This has led [McCarthy to mak“= tr.e clain and justly so 
that "lIS? will become obsolete when someone makes a more 
comprehensive lan,^uage that dominates LIS? practically and 
also sives a clear mathematical spmantics to a more 
comprehensive set of features [34j." Altnough LIS? is 
adequately suited to most current AI programming- needs, 
capabilities such as pattern matching, meaningfully 
organized data storing, and user defined data stru'^tures, 
all of which are becoming increasingly important to the 
implementation of applications systems, are not offered. 
However, LISP does provide the framework for building higher 
level languages that do offer these features. SLIS?, 
CONNI'^E?., and PLANNSP are examples of such languages. In 
seeking a higher level of program abstraction certain 
flexibilities are inevitably sacrificed. This is mcst oft^n 
the case when the new extensions are convenient for certain 
types of applications. If an application is an unusual one 
and efficiency is required the designer is usually for'-ed 
lack to a familiar basic ianguage-sucn as II??-to eitner 
utilize directly or build a new special purpose language 
upon (e.g., the PP.OGPAb’^AR language in Winograd^s PHPLL'J 
system, see Appendix PK PLANNBP. fell victim to such a 
circumstance. PLANNER'S emphasis is or its ability to 
proceduraliy embed knowledge. Global backtracking was 
included to relieve the programmer of having to specify how 
it should be done, thus making the language as nonprocedural 
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as possible. What >,as not anticipated was the nurrler of 
applications that preferred a ^LAiMN3H-like lan^ua^e for 
implementation but required programmer control over 
backt rackin,e , as in the case of learning systems. ?LANN3R 
has nevertheless made a significant contribution to lan^uaee 
design. It has pointed out a path toward the ultimate 
desirable characteristic of any AI language, that of 
nonprocedural! ty (see appendix A). 

C0NNI73H is an improvement over PLANNER (e.g.. global 
backtracking removed) and it is an implemented language 
wnereas full PLANNER never has been. C0MNI7ER is of course a 
PLANNEF.-like language. Therefore one may program 
instructions to the system such as "imagine you were to do 
that, and tell me what would happen if you were to find that 
such and such were true," or "What did you learn about this 
while you were trying out that hunch that eventually you 
abandoned? [5]" Fere, as in most C0NNI7ER jjrcgrams , tne 
programmer is relieved of the considerable detail of 
specification of the manner of achieving various goals. 
"Such intellectual subtleties are not straightforwardly 
expressible [5] ." 

Another PLANNER-like language is PPOLOG. Unlike PLANNER 
it is not based on LIS? and it does nave working compilers. 
Pattern matching is extensive and an assertional data base 
is provided [36]. The efficient usage of this language is 
highly dependent on the expertise of the programmer. 
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Althou^ii current users are nearly fanatical in their 
devotion, it is not an easy lans^ua^-e to learn and will 
likely not acquire massive popularity in the near future 
[36l . 

The rOPLER lanffua,?e is again FIANNSE-1 i ke . It is 
written in a lower level language called POP-2 which is 
similar to LIS? in many respects. POPLSF. comhines features 
of PLANNER and C0NNI7EP. It has borrowed tne concepts of 
assertions and theorems from the former and context 
mechanisms from the latter. Also, as in PLANNER, a failure 
mechanism and backtracking are an important part of the 
control facility. However in POPLSP. the user is allowed to 
specify failure actions via an "action list." FCFLER is a 
well-documented and user-friendly system tut has not yet 
been used for any major projects and currently resides only 
in Edinburgh [4] . 

"’here are a few other languages that have no relation to 
LISP, and are not PLANNER-like , but are AI languages 
nonetheless. They include TELOS, A3SET, and SAIL. TELOS, 
founded on the PASCAL language, provides pattern-mat''hing, 
an elaborate u ser-def ineable data structure mechanism, 
coroutine capability and even demons. It should be able to 
compete successfully with most of the popular AI languages. 
No major systems to demonstrate its potential have as y=t 
been implemented in TELOS. 
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The ASSET lan^ua^e is founded on ASSiS, a declarative 
language with heavy emphasis on the use of propositional 
logic. ASSET is extensive improvement over its 

predecessor but maintains the same goals, that is, to 
distinguish between the ordering of decisions and the 
ordering of evaluation, and the manipulation of partially 
evaluated programs [16j . These are valuable iaeas for AI 
applications systems development. Like TELOS , no major 
system has been written in ASSET making it difficult to 
remark on its practical merit. 

SAIL is an established , relatively well-known language. 
It is an extension of LEAF which is based on ALGOL 6? 
constructs. It has its own compiler, a feature that makes it 
unique among most AI languages. It has a few limitations 
however, including the fact that erasure of abandoned 
storage is the programmer's responsibility, as is the 
specification of which variables to save or restore upon 
backtracking. Lists are a recently added data type but will 
not efficiently represent multi-level linked structures such 
as trees and graphs in a uniform way. However, SAIL does 
have elaborate process control (see Coroutines, Chapter IV ^ 
and some new communication features. It will likely maintain 
its current, general popularity as it evolves in a stable, 
reliable manner to meet the reeds of its users [4l . 
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Finallv, CLISP, another ?I\NME?.-1 i'rce lan^euare, offers a 
rich variety of ’data and control structures over which the 
user may opt for control. The most hopeful prospect fo^ a 
2 -eneral, efficient, and flexible pro^?rammin^ system for AI 
lies in a OLISP/INTERLIS? marriage [4] . INTEPLISP is an 
extension of LISP 1.5 and currently the preferred lar^uae-e 
for applications systems implementation. Its popularity is 
erowine- as it offers the user all the desirable basi^ 
features of LISP plus aids that make it more user-f ri end Iv . 
The two-lan^'uas'e proprammin^^ system is presently under 
development. It is likely that AI programming will proceed 
in the direction of CLISP/INTSP.LIS? until a major conceptual 

breakthrough is made in the way in which programming is 

/ 

approached . 

Although LIS? has been the standard Al lana-uape for over 
two decades it has only been in the last few years mat it 
has acquired most of the popular attention that it now 
receivps. Either mere users and system implementers 

discovered a need for its capabilities or were simply 
finally ready to accept its unfamiliar appearanc®. Likewise, 
the next major advance in pro^’ramming languages will 
probably be based upon an old idea or a current one perhaps. 
Por instance, it may include Packus 's notions of functional 
programming, that would liberate programming from its von 
Neumann, word-at-a-time , style. No doubt. this would 

ultimately be beneficial to AI programming needs. 
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A?F3,\DIX A 
??0C£LITRAL'nIF5F 



In the roughest sense, proceduralness refers to the 
decree to which a prograrrminc' lan^uae’e will allow tha 
programmer to specify how operations on data are to le 
carried out. Thus, a lack of pro cedural ness constrains a 
programmer to merely specifying what is to be done to the 
data, while the system is left to worry about how lo do it. 
Procedural vs. nonprocedural may also be viewea as the 
difference between explicit and implicit specification fcr 
processing of information [25j . At one end o.f the spectn;m 
exist these nonprocedural, or declarative, lancuaj?es !'i.e.. 
the "what” languag.es), while at the other end can be found 
the procedural languages (i.e., the "how" languages"). .Amcng 
the latter, as far toward the end as one may = o , are macnine 
languages fin which a programmer must „ive tne most detailed 
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report veneration languages , in which a sample command A-culd 
be "calculate the payroll for tne APC Company." 

According to Sammet[^cJ, a language demonstrates its 
nonprocedural cnaracter in one of two manners. Pitner tne 
user is required to submit an ordered sequence of steps, 
each of whicn is ’somewhat nonprocedural", or a set cf 
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execuiatle o^eratioriS whose sequence is noi user-specified. 
Repori e'eneraiors (e.^., H?G) are constrainec in application 
and the user need only specify the input and desired output 
witnout any specific indication as to the procedures needec. 
Thus they are exemplary of the most nonprocedural lahe*ua?es. 

It nas been contendea that progress alon? the 
hcw-to-wnat soectrurr may be considered as a measure cf 
progress in A I re sea re h, provided that a proper p-oal therein 
is to create sophisticated 'declarative nii,hh“r level 
lansua=^es. Nilsson [3c] feels that AI lan.?ua^es are already 
moderately far along toward dne "wnat" end c: tne spectrum. 
rlANNZE is probably the most declarative of the current aI 
languages. It is a goal-directed language in whicn tne user 
m.ay "specify high level ^•oalb in ^'eneral terms '«ithout 
individuating all the particular objects and. epe rat ions 
involved in their achievement [5]." It has established the 
model for nonprocedural, or rlANN i-.-iige , languar’^s. 

Here a<^aiR, the user specifies "what" rather than 'how'. 
In PIANMZ” , one states a goal tnat the syster^ tner ra‘cnes 
to the index of ,s-ener-=i patterns and for whi'^h it attends to 
'"f^rtair boo>:keeping matters. However, -lAMNZ'^ has been found 
to be "inefficient and hard to control [3c]." Only a portion 
nf it, called ^’icrc-~IAiM,NZ? nas ever been fully ir^.lemer te'd . 
In fa''t, it seem.s that PLANNER'S major drawba''l< is its 
i nf lexi'^i li ty . •'^ost users want more control than PIA.NN^R 
allows, to tailor some procedures such as depth-first search 
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ana ca cict ra (au^opiatic f6atu’'es of tne ian^vafi.'e ' . to 
T.cre efficipr. tly fit tn? particular proMa>.7; at nani . Cut of 
tnis type of frustration, Sussnan and ■•’cLernott [55j createa 
tine C0NiM”ER language. C0NNI’'3]R is ncre procedural, and was 
designed to implement Sussman 's pro'clem-solvine' system, 
HACKER (see Appendix 3). Curing tne in.wlement a t i on Ine 
discovered potential inefficiencies and need ends of wnicn 
ne would otherwise nave remained unaware nad ne continued to 
prOfCram t’ne system in rlANMiR. CCNNIKH? allows sreater 
programme r control ever liacAtracIcing for mere efficient 
t ree-sear chi ns . 

The tasic argument in favor of worKins toward tne 
development of increased nc nprccedu ra lr.es s is that 
declarative language s are relatively easier for people to 
understand and communicate. Tne programmer is also freed to 
think about a problem at a more acstract level, rut, in 
order to accomplish the goal of developing a sopn is t i ca te d 
nonprocedural prOf-ramring language for AI tne computer rust 
have stored within it a large am-ount of backgreunu and 
knowledge of the subject ratter of a request. Thus the more 
nonprocedural a language is, the mere kncwledge it rust nave 
procedurally embedded withn itself. FLANh'ZH, without a 
doubt, is furthest along in this d'^sign. H®witt nas 
developed and incorporated into FIANNSE a ’Thesis of 
procedural embedding" wni^h states that "i'^t'=ll-ctual 
structures should be analyzed tnrou-'^h their procedu’-al 
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ana 1 Of-ue? • " For example, tne analogue of a data type is me 
set of procedures which create, destroy, recca’nize, and 
transform data, or, the analorfus of a drawing is a procedure 
for makins* the drawing- [27], 

A lan^uape that is even more nonprocedural than PIANNER 
but, still far less nonprocedural than a report '^eneratc". 
is an older lan,‘^uage, CO'^IT, which was created to facilitate 
strine- data handling, everything to be done in this lan^?uame 
is embodied within a so-called "rule". Any action to be 
taken depends upon notation and position within thp rule 
[43]. 

The format of a COi'^IT rule is: 

statement latel tar^st pattern = actior // ^’C-to 
In each rule, tne programmier specifies wnat the pattern 
interest is, what is to be done if the tareet pattern is 
found, and wnat location to brancn to in order to find the 
next rule to evaluate. An entire CCN'IT proerar is nothinc 
mere tnan a series of such rules. 

Nonprocedural is really a relative term that ir. fact 
changes witn the state of the art. As compilers are 
developed to cope with increas ini’!;/ complex sentences, the 
nature of the term changes. Thus, what is considered 
nonprocedural today may well be procedural temorrow . 

The debat<= over tne amount of proceduralness an AI 
language should possess will li-cely continue for sore time. 
The principle is that of tne proceduralist versus the 



119 



d 

■ 



dec la rai i V is I phil os opy of ’^no wledse representation. Tf e 
claim of tee procedv ra li s t is teat knowledge smiild te 
represented procedural ly , ratder than fa'^tually. ?or 
example, the information that 

"all weekends are relaxine-” 

would be represented in a declarati vi s t 's data base in 
exactly that form, i.e., as a single specific fact. A 
procedu ra 1 is t , on the otner nand , would represent it in a 
such a way as to allow it to te used more flex.ihly. The fact 
above could represented with four statements, eacn with a 
slimhtly different viewpoint: 

1. 'Something is relaxing if ev<=r it is found tc 
he a weekend. 

2 . (Alternatively) if one wants to snow s ome t hi ng 
is relaxing, then trying to shew tnat it is a 
weekend miay be a good way . 

(These are the ante'^edent and consequent chci''es tha’’ 
cannot te shown witn a declarative representation.) Then 
there are the parallel possibilities taxen from the 

negations: 
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S. If SOP"? thine- is shewn to he not relexinr. 
then one nay deduce that it is not a weekend. 

(Alternatively) if it is desired to show that 
somethin^’ is not a weekend, then snowing it is 
not relaxing nay he reasonable [64] . 

1 pr ocedura 1 i 5 t does not like to d^fer tne decision about 
how a fact nay be used. The decla ra t i vi s t however, would 
prefer to do so while claiming intent to avoid predjudicing 
the future use of the fact. 

There are some sound arguments favoring both sides, 
such more nonproceduralness in a iancuap-e implies a 
lower amount of programming effort to produce a working: 
program. However, it also implies a loss of or os rammer 
control over I/O functions and inability to minimize memory 
usage or execution time through more direct control of 
hardware operations. In figures A1 and A3, Fletcher nas 
clearly identified the advanta^^es and disadvantages c* 
procedural and nonprocedural languages , in general. 

The dichotomy among proficient programmers fer 
preference of explicit control over various mecnanisms has 
prompted some language experts to suggest tne establishment 
of a "proceduralness factor" [52] . If macnine code 
represents the most-procedural end and a true 
problem-describing language tne most-nonprocedural, then 
all other languages could be each assigned some value 
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indicatirie dov close it; is to one end or tne otiier. This 
would be an interesting exercise, however the final result 
would le little more than i nf o rna ti oral (see fif. A3). A 
proeranner looking for a lan^uas'e in whi^'h to express a 
problem would not nave an appreciation for the difference 
in utility of two closely valued langua^'es (like CONM’^Z?. 
and PLANNER for instance) unless he or she has prior 
knowledge of the basic differences between the two 
lansuae-es. This is particularly true when considering 
languages that may actually be a mixture of procedural an;'' 
nonprocedural parts. 

It would be more useful, tut of course more complicated 
as well, to devise some type of ’’measuring scale by which 
the amount of p ro ceau ralnes s , to be specified by tne user, 
can be defined for any given language [S?]." A feature such 
as this in PLANNER would have obviated the necessitv of 
creating C0NNI7ER. 
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PROCELUPAI: 'Machine Code 

Relative Procedural ness 
of AI Languages. 

r i ?u r e A3 
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APPENDIX 3 



APPLICATIONS SISTERS 

Practical applications of Artificial Intelligence 
research can he found in irelicinef chemistry, seolop.'j , 
general science, psychology, and coiTmorser.se 

prohlem-s 0 1 V in^» . Systems currently operatinx^^ in som^ of 
these fields are being utilized as knowledge experts, or 
consultants. Some prominent and successful examples of such 
systems are included in this appendix. 

Th° following information is presented fcr eacn system: 

1. Principal designer(s) 

2. Location of system development 

3. Date of introduction 

4. Implementation language ' 

5. Functional description 

6. Oenerai design characteristics 

7. Where possible, accomplishments and/or 
limitations of the system are presented. 

Some common terms and concepts referred to in the 
descriptions of several of tne systems dis'"ussed are 

explained below. 
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i. Theoreri prover: 

A prosrar v-hose function is to deduce theorers fro"- an 
axionatic ’case of lcr.owledf:e by using strictly logical 
methods of reasoninf?. Some prosrams employ very ^^eneral 
methods, which are universally applicable in principle 
althou.?h not necessarily always sufficient in practice to 
solve the problem at hand. Resolution is an example of such 
a general metnod, whereby an assertion is snowr to '^e a 
theorem by proving that its n^p-ation is impossible [5]. 

ii. Cuesticn-answerer: 

A Program which allows the user to interrogate a data base 
(generally, domain-specific) via a ratural language (e.g., 
Rn^-lish). Ideally, the system (proe’ram' should be able to 
"store a large number of facts and respond to -easor.able 
questions whose answers could be deduced from these facts 
iccj . 

One of the first question-answ®ring (C-A) systems to 
nave been developed 'was one cal lea rASZIALI [•'^5] . Inis 
system, written in IPL-V, could answer questions ashed in 
ordinary English about the montn, day, place, teams, and 
scores for eacn baseball game played in the America” league 
in one year. The primary goal of the development of rASSiAIL 
was to provide some insight to possible basic mecnanlsms for 
lan?uaee comprehension.' 



127 



I 



' C-A system sncn as BASS3A.LL is made i:p of t*o l:aslc 
parts, a lin^'Uistic part and a processor. The lin^uisti.-' 
part syntactically parses ( semantically as well wnere 
possible) the question and determines what information is 
bein^ given about the data being requested. Tne processor 
searches throu^’h the data base for the appropriate 
information, processes tne results and reports the answer, 
usually in an abbreviated form [35]. 

iii. Generat ion-and test: 

A technique first introduced in GPS, in wnich plausible 
guesses are made of solutions Crec-arding differences to 
reduce between an initial state of a problem and a goal 
state) and then tests are made to see how well the ^uess 
fits the circumstances [3c]. 

Different systems have different veneration processes 
for proposing solution hypotheses. Tne particular process is 
usually dependent on the nature of tne task. Per =mample, 
DEiNDEAL employs a combinatorial algorithm *hat can produce 
all the topologically legal candidate structures for an 
unknown orvanic molecule. Whereas giCIN uses a lovical rule 
of inference (backward chaining of production rules' [IT] . 

iv. Hierarchical vs. Heterarchical control: 

In hierarchical control (the most usual type) one program 
has overall control. All others are subordinate to it as 
subroutines are to a master routine. Subordinat“ programs 
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need not be directly accountable to the highest one, since 
tnere nay be sevpral levels of ^nierarchy.' However tne flow 
of control passes in one direction only, downward. Moreover, 
no 'sideways' communication is allowed [5]. Figure B1 from 
[5] is an example of hierarchical control between proarams. 

In heterarchical centred, tne responsibility fer control 
is more equally distributed usually throughout the system 
with a greater degree cf internal communication. Programs 
can address or call one another either 'up,' 'down,' cr 
'sideways.' furthermore, they may do so at different points 
in their processing- [5]. Figure F2 demonstrates a 
heterarchical control seneme [5]. 




Hi erareny 
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AM 



1 . 

Douglas B. Lenat 
Carne^ie~Mellon University 
1976 

INTEP.LISP 

Functional description: 

AM's task is to formulate scientific tn=ory. In 
particular to make new definitions, explore new concepts and 
judge the "interestingness" of its discoveries. 

AM is a theorem proposer, as opposed to a theorem 
prover, in a primarily mathematical knowladge dcmain . 

General design cha racteri sties : 

AM is a heuristic rule-euided system, consisting of a 
set of a few hundrea rules. 

It works on packages called "concepts" whicn are mad“ 
up of many "facets". The facets are attributes of some 
concept that AM would be exploring at seme point. Example's 
of facets are concept name, associated aefinition, exa^ple«, 
analogies, etc. AM makes repeated attempts to fill in values 
for (make discoveries about) these concepts. Each concept is 
represented as an active, structured knowledge module. One 
hundred very incomplete modules are initially supplied, each 
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one corresponding to and elenentary set-tneoretic concept 
(e.p:., 'Jnicn). This provides a definite hut irrvense space 
which AM begins to explore. 

An ap’enda of ’’jobs" is maintained. A job could be 
finding a value for a facet in a concept. When a job is 
chosen for processine* all potentially relevant heuristic 
rules are gatnered and executed. A typical agenda entry 
would be: 



ACTIVITY: Till in some entries 

FACET: for the GENEHAI IZAT IONS facet 

CONCEPT: of the PRIMES concept. 



Reasons : 
( 1 ) 

( 2 ) 

(3) 

(4:) 

Priority: 



because 

There is only 1 inown ?ene rali za ton of 
PRIMES so far. 

Th® worth rating of PRIMES is now very nigh. 
Focus of attention: AM just worked on PRIMES. 
Very few as are PRIMES? a slightly more 
plentiful concept may be more interesting. 

350 (on a scale of 0-10C0} [29]. 



Accomplishments /I imitations: 



In one hour of CPU time discovered tne obvious finite 
set theoretic concepts and reiat ionships sucn as PeMorgan's 
laws and singletons. AM also discovered Squaring. 
Squareroot, Natural as, fundamental theorem of arithneti'' 
(unique factorization into primes'), Goldbach's conjecture 
(every > 2 is the sum of 2 primes), and literally hundreds 
of other common concepts [29] . 
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AK quickly finds its limitations as it nas no a'bilit?^ 
to discover or create new !"euristic rules. Anotner system 
under development 117 lenat, called EUP.ISrTO, attempts to 
improve on Am in just that regard [P7] . 



2. 3UILD 
S .S . ranlman 

7 

1974 

CCNNIVEH 

Functional description: 

BUILB is tasked with solving logic or common sense 
problems occurring in a "blocks world". 

General design characteristics: 

build's knowledge base includes facts about tie physics 
of weight and levers, stability and friction. 

BUILD is heterarchically organized around seven high 
level procedures. These modules each nave memory ard 
reasoning power that allow them to call one another when in 
trouble. 

A typical task would be to rearrange an odd assortment 
of blocks into a specific order. BUILD starts by drawing rp 
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a very sirple plan, wriicn is f:ra dually elatcrated as 
necessary or at the request of other experts. The first plan 
follows BHILES comparison of goal state with initial state 
and is simply a list of the blocks that are not yet in their 
correct position. The list is ordered, its first memters 
beinff those blocks whose supports (table or other blocks) 
are already in position. Starting with these, SUIID plans to 
call the PIACE routine to deal with them one by one. If 
FIACS succeeds immediately in eacn case, the problem is 
solved [5] . 

Accomplishments /Limitations : 

The modular pro;?ramming approach yields easier 
understanding of the functions of the various parts. Also 
5UILD need not compute thoroughly beforehand all the facts 
that may be relevant. The system is capable of backtrackirr 
and utilizing all pre-faiure information before choosing an 
alternative path. A'hen it fails EUIII does not back up to 
the previous choice-point and pick an alternative method at 
randomj instead it uses its understanding^ of its failure to 
select the method mcst likely to succeed. If tne failed 
method is due not to unfortunate choice of method but rather 
to a small local difficulty in applying it, 5TIIL can adjust 
this as reouired and restart the failed method [5] . 
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i . Fe ip’en'baurr’ , H.?. Mi, F. Fn^elrore 

Stanford University 

1377 

INTSRLI3? 

Functional description: 

The CRTSAII3 systern hypothsizes the sfu^ture of a 
protein from a map of electron density that is derived from 
x-ray crys ta llo^'raphi c data. 

C-eneral design characteristics: 

CEYSALIS is a knowledge-lased , ^ule-g’'ided inference 
system where tne rules are of tne form: 

situation => action 

The 'situation' can he thousnt of as tne current nypcrnesis. 
The 'action' is a process that modifies the cnireat 
hypothesis. Internally, tne s i tua ti on-nypcthesis is 
represented as a node-link graph *ith distinct levels, each- 
representing a degree of ahstraction. A node r<=pres-rts an 
nypothesis and a lin>' represents support for a nypothesis. 
The s i tua ti on-hypo tnes i s is formed incremientally via a 
sequence of local penerate-and-tes t a'^tivities. 
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A sirpl ifyir.5 strategy is ent:loyed taat, T.aintains criy 
one best s i tua t io a-hypothes is at a tiir,e and rodi^'ies i; 
incrementally as necessary as tne data chanecs [ 1 ?J . 

4. BSCAirs 

T. Buscemi and J. yasica 
Naval ros t^?raduate , Monterey 
197 ^ 

iN'TERIIf? 



Functional description: 

BZCAirS vves deslyned to assist in tne or- ani ca t icn C’ 



decision aiding cinaracteri 
resour''e allocation alt 
concerning' tne organization's 
and structure characteristics 
an interactive consul tat i cn 
then provided by tne syster. 



tics relating 


to corrputar 


rna tiv“s I'^j . " 


Inf orr tier. 



tds’t, techno lopy , ervironment . 
is s 0 u.-.'h t f r orr the user d u r i r-.g 
session. ? ecof rrenlat i o n' a’’a 
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C-eaeral design characteristics: 



DECAir? is a knowledge-'ba sed proiuctioti rule systen that 
eirploys a backward chaining search strategy. The knowledge 
base consists of 41 rules and 23 parameters represented in 
an implied ANT/OH tree. 

The framework of Stanford University's inference 
enerine (a product of the MTCIN project) was adapted for 
BECAIDS \7] . 
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. Feit-entaun and J. Lederterf 
Stanford "nivprsity 
1935 

INTSRLI3? 

Functional iascription: 

DFiNDFAI's tas^ is to assist tne anaiyiis cnenist in 
e nure ra t i nr: plausitl® structures (atcm-'bond r,'ra piis- fcr 

organic nolccriies. Gi'^en an ocserved f rac-nen t a i i on pattern, 
FFi\DRAL hypothesizes the best structural explanation of the 
data. Its pripary source of eppirical data is a pass 
spe-'t rcmeter-an instrup-ent that fra^pents polecules of a 
Chemical sample (usin^ an electron leap) and records the 
results. A pass Si^ectrum, tne output of tne r^ass 
spectrometer, is a 2 dimensional recoru of tne aturdar.ee of 
various fragpents plotted as a function of tneir pole'^ular 
v^eis’hts. A secondary source of data is a nuclear ra^neli", 
resonance spect.rometer(N''’F) . 

DoNDRA-L's output is a ^?^aph, i.e., a topoloeical model 
of the molecular structure of the unf'novn coppound , or the 
output is a list of plausible molecular 3-raphs, rank ordered 
with their relative plausibility scores. 
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The 1 0 ta i size of i he pr c ble.^ space is the nUiTbe r of 
t^opoloticallv possible molecular structures per.eratec v,itn 
valence considerations alone. 

He tarEwEFuAI wor^s with lEXTRAL to au toma t i cal ly forr. 
test, and modify inference rules. It infers rules of mass 
spectrometry by induction from empirical lata for possible 
late^ use by DSi\'I)HA.I. 

General design c^a racte ri s t ics : 

ESNDEAL is a heuristic rule-guided system. Eules are of 
the form: 

situation => action 

each with an associated probability of occurience. 

Goa 1-s ee’-ciri!^ and achievement is done via the tinree sta^e 
process, plan-gene ra te-tes t [17] . 

Accompllshments/Limi tations : 

Heuristic DENIRAL has solved hundreds of structural 
inference problems, most recently of structures in the 
family of organic amines, for which the analysis is 
reasonably comlpex. The improvement in running speed of 
solving these problems usins the specialized heuristic 
methods found in D2MERAL over solving them by more general 
methods is estimated to be as frreat as a factor of cv.iCG 
[ 6 ] . 
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6 . SI I A 

J. A'eizentaun 

('‘’IT & Stanford ’Jni versity 

1966 

COM IT 

Functional description: 

SinA is a question-answering system mat is intended to 
simulate the conversations between a -psy-rhcanalyst (the 
machine) and a patient. The point of interest is the 
two-person conversation [5] . 

General design cnaracteristics : 

Noncompiital natural English statements are generated by 
ELIZA in response to questions tendered in English as v/=ll. 
The system does not 'understand' questions bur rather 
attempts to make s<=nse (i.e., find an appropriate response) 
of them through extensive pattern matching and 
classification [35]. It looks for key words, e.g., I, you, 
alike, father, etc. If found the sentence is transformed 
according to a rule associated with tne word. If nc key wcrf 
is found ELIZA responds with a content-free formula such as 
"Why do you think that?” or with a reference to an earlier 
remark . 
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The kncwlsdt^e tase is relatively small, a ccnsequence of 
havin,^ chosen the psychiatric mode of conversation. Recent 
versions employ frames to make 3inA mor® xnow led^eat le . A 
frame is an or^^canized tody of data, in this case comprisir.e.' 
a specific set of key words and associated transformation 
rules [5] . 

Accomplishments /Limitations : 

ELIZA has no capability for under s tandi Ce-' the se'-antics 
of the conversation in which it participates. Rcwever, it 
-successfully presents the illusion of sucn. It nas lured 
many knowledgeable individuals, even sophisticated computer 
scientists, into enpas’ine' in personal conservations [35]. 
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7 . SPAr^ 



P. Pei^?enbaum and H. Sirnon 
UC , Bericelev and SAND Corp. 
1961 
IFL-V 



Puncticnal description: 

ZFA!^ (Zlenentary Perceiver and Kemorizer) was designed 
to model tde iiuman cognitive process of tne rote learning of 
nonsense syllables. It is an information processing 
psychology model of a classical ph'=nomenon (rcte learning) 
well-lcnown in the literature. It serves also as a simulation 
of verbal learning behavior [53] . 

General design characteristics: 

SPAM Utilizes a discrimination network as tn= basis fcr 



an associative 


memory scheme. 


The 


net 


is an adap 


structure that 


can grow over 


time 


tc 


inrorcoratP 



stimulus objects that need to be recognized in an efficient 
manner [5] . 
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Acc orrpl is hpen ts /L imi ta t i ons : 



The iiscrirrination net concept of S?A!^ nas been adapted 
for other applications, including chess playing- proeratris , 
where it used to represent the patterns of chess hoards 
during play [3"^] . 

SPAl^ successfully provided a clear and simple 
information processing’ structure? the patterns were easy to 
understand and gave rise to complex lehavior and interesting 
explanations of phenomena that were well understood 
experimentally [53], 
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3. G3N23AL ?'03I3f^ SCIV3R — G?S 

k. Newell and H. Simon 
Carnegie Teen., and RAND Corp. 

1973 

IFL-7 

Functional description: 

GPS grew out of tne LOGIC TESOEIST Yacnine [3'^j . It wa? 
aimed at trying to solve a variety of unrelated logic 
problems. Emphasis was placed on attaining generality in 
protlem solving. Tne Quality of tne problem solving process 
was a secondary consideration [37]. 

General design characteristics: 

G?*^ employs a neuristic searen paradigm. Tnis method 

consists cf two entities, objects and eperators. An operator 

wnen applied to an object produces a new object or indicates 

inapplicability. A heuristic search problem is: 

Given: An initial situation represented as 
an object. 

A desired situation representation 
as an object. 

. A set of operators. 

To Find: A s^ouence of operators that will 

transform tne initial situation into 
the desired situation. 

The operators are rules for generating objects ann thus 
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define a tree of otjects. lacn node represents an cbjert and 
eacii trancn fT’om a node represents tne object prodnced ty 
tbe application of the operator. 

A metboa for solving a Heuristic seared problem is to 
search the tree defined by the initial situation and the 
operators for a path from the initial situation to the 
desired situation [37]. 

The effectiveness of this method is determined by its 
rules for selecting operators to be tried (rules for guiding 
the search) There are two basic criteria for selecting 
operators t 

Desirability — the operator should produ''e 
an object that is similar to 
the desired situation. 

Feasibility — the operator should be 
applicable to its input 
object . 

t 

GPS uses the heuristic search paradigm directly? a 

problem is given to GPS in terms of objects and operators. 

It employs a general technique called means-ends analysis to 

guide its tree search. Means-ends analysis is accomplished 

by taking differences between what is given and wnat is 

wanted, e.g., between two objects, or between an obiect and 
1 

the class of objects to which an operator can be applied. A 
difference designates some feature of an object teat is 
incorrect. GPS uses the difference to select a desirable 
operator — one that is relevant to re'^ucing tne difference. 
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If dn operator is not applicatle to an object* an atterrpt to 
apply it will result in a difference — tne reason it is not 
applicable. If the difference is not too difficult, GFS will 
tackle it as it would any difference between two objects. If 
it is successful, a new object will be produced that 
hopefully may nave the operator applied to it. 

GPS has four types of ^oals that application of tne 
operators attempt to achieve: 



1. Transform object A into object r. 

2. Peduce difference D on object A. 

3. Apply operator C to object A. 

4. Select the elements of set S which 
best fulfill criterion C [37 j . 

i 

I 

Accomplishments /Limitations : 

I 

I The introduction of means-ends analysis provided a new 

I and widely applicable method of foal achievement [5j . 

GFS successfully solved a variety of problems includin?': 
tne f^issionaries and the Cannibals problem, Intetratior of 
, problems such as (sin (ct)cos t(''t) t )lt, the Towers of 
Hanoi problem, the Fridges of Konifsberg problem, Letter 
series completion (e.^., complete the series: FCFri?...' 

problems, and many others [37]. 
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HACKER 



9 . 



G- . Sussrran 

MIT 

1975 

CONNIVSP. 

Functional description: 

/ 

HACKER operates in a tioc’rs world wnere its task is to 
develop procedures for petting a 'blocic or ?roup of blocks 
from an initial conf igurat i on to a spe'^ified goal 

conf ipura t io n . 

General design characteristics: 

HACKER uses means-ends analysis (see GPS) to accomplish its 
task. The data base maintains information cn operators 
(actions), as well as preconditions and effects of tbe 
operators . 

Initial plans are rougn so that when mistakes are -ade 
HACKEE must analyze what went wronp and where. Special 
debugging programs are supplied for this. Mistakes are then 
classified, ^generalized and placed on a list of traps to be 
avoided later. 
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Accomplisiinients/Limi rations : 



HACS3R tray te considered a system for automatic 
programming, in tJaat it is a problem solving program tnat 
itself writes and improves programs and learns to do so 
ijetter with practice [5], 



\ 
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1£. INTERNIST 
Rople 

7niversity of “ittsbur^h 
1975 

INTSRIISP 

Functional iescription; 

INTERNIST is a system developed to provid<= support in 
the formation and solution of difficult clinical problems in 
internal medicine, 

General design characteristics: 

INTERNIST is a knowledge-based system wherein the 
knowledge is represented in two different element types; 
disease entities and manifestations. Tnere are about 
disease entities and over 2£i:£ manifestations 'including 
symptoms, lab data, etc). Sacn disease entity nas an 

associated list of manifestations. A value between one and 
five is assigned to each manifestation estimating its 

frequency of occurrence. By the same token, each 
manifestation has an associated list of disease entities, 
each of which has a weighting factor between zero and five. 

A partitioned semantic network is used to represent a 
hierarchy of disease categories , organized primarily around 
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tte concept of or^?an systens, e.^., liver, lunf , kidney 
diseases , etc. C‘i0] . 

The nurrher of distinct disease entities known to a 
practicing physician is about 42. However, a patient may 
demonstrate /symptoms of the co-occurrence of several 
hitherto unrelated diseases. If an upper bound of ten is 
imposed on the number of concurrent disease processes 
possible, then the number of diagnostic cate£*ories required 
to classify arbitrary patients is of the order of ten to the 
4?th . 



Accompl ishment s /Limi ta t i ons ; 



INTERNIST II is a recent enhancement of t''e original 
internist system. It embodies strategies of concurrent 
problem formation that yield more ravid conver-?ence to a 
correct diagnosis ir. many cases, and at least some cases 
provide more accurate results [*^2]. One ■'omclex case on 
which INTERN IS'^ II consulted produced a diagnosis ''ons is inh 
of: primary cardiomyopathy, congestive heart failure wit'- 
pleural effusion, transudative ascites, cardiac cirrhosis 
resulting from chronic hepatic congestion, and acut“ tubular 
necrosis of kidneys caused by cardiogenic snook. Evidence of 
systemic embolism was also reported [42]. The sy'^ter’ 



required 92 seconds of execution time to generate that 
particular diagnosis of wnat was considered a relatively 
complex case. 
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11. 



S. Snortliffe, E. Davis, £. xucnanan 

Stanford University 

1976 

INT5RIIS? 



Functional description: 



M'^CIM was desig’^ed to assist a physician hy providing 
consultative advice on diaf'nosis of and therapy for 
infectious diseases — in particular bacterial inferticus in 
the blood. The system is capable of handling interactive 
dialogue regarding the diseases and capable of supplying 
coherent explanations of its results [11]. 



General design characteristics: 

MYCIM is a rule-guided inference system that employs a 
backward chaining search strategy. A certainty factor 
between 2 and 1 (i.e., probability) is associated with each 
conclusion . 

Each rule embodies a sina*le, modular chunk of knowledge 
and states explicitly in the premise all necessary context. 
Specifically, a rule is a simple ccnditional statement 
( IF /THEN or premise/action format). The premise is a Soolean 
expression. The action part contains one or more 
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/ 

conclusions. Each is compleiely nodular and independent of 
the others. They are invoiced in a hackward ur-windin^' scnene 
that produces a depth-first search of an ANT/OF. foal tree 
(similar in some respects to ?LANNE?/s consequent tneorems ) 
of more than Z2£ rules. The m.<arimum number of rules for a 
single subgoal is 30. '^eta-rules are available as strategy 
rules for sugmestin^ the best approach to a given subgoal. 
They have the same format as tne clinical rules but can 
indicate that certain clinical rules should be tried first, 
last, before others, or not at all. Tnese then provide a 
capability for pruning the search tree, thereby reducing the 
feasible search space. 

Accom.pl ishments/Limi tations : 

In mid 1974 a semi-formal study was conducted in which 
five infectious disease experts not associated with the 
project were asked to evaluate the system's performance on 
15 cases of bacteremia selected from current natients. The 
experts approved of i’^TCIM's tnerapy recommendations in 72% 
of the evaluations. This is a significant appraiscl of 
M'^CIN's success especially considering that the experts were 
not unanimous in their own recommendations [11] . 
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12. PROSPZCTOR 

R. Duda , P. Hart, P. Barret, J. Gaschnis^, 
5. Konolisre, ?.. Retoh, J. Slocum 

A I Center, SRI International 

1976 

IMTPRLISP 



Functional description: 

PRCSPFCTCR was designed to assist erpioretion geologists 
in interpreting and evaluating data on specific rineraliz=“d 
sites or prospects [15] . 

General design characteristics; 

PROSPECTOR is a knowledge-tas ed , rule-guided inference 
system organized internally as a partitioned semantic 
network. The partitioning is hierarchical, in order to 
represent a taxonomy of minerals. Top-level nones of the net 
correspond to top-level hypotheses about the presence of 
various types of ore deposits. Lower-level redes may 
correspond to directly observable geologic data, or to 
intermediate concepts that can be inferred from observables. 
A principal taSK is to infer probabilities for the top-level 
hypotheses on the basis of available observations [l4l . 



t 
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Huies are of tne forn, A => E. A protabilit/ factor is 
associated with the conclusion 3. Two additional nurhers 
measure the degrees to which A is necessary and sufficient 
for B . 

Accompl ishments/Iimi tations : 

This system has been employed successfully as a teachini? 
tool for learning about types of ore deposits. 

PROSPECTOR has a slight handicap in that a body of 
observations, often uncertain in nature, must be interpreted 
with the aid of a >nowledge base that supports plausible 
reasoning but not strict logical inference [14j . 



153 



SERDLU 



T. Vino^rad 

•MIT 

1971 

^icro-FLANNS?., LISP, FROC-RAMMAH 
Functional description: 

Tiie SHRDLiJ program represents a rodot tnat car respond 
verbally as well as actively. Emphasis is placed on lansuap-e 
interpretation rather than e’eneration . SHF.IIU's area of 
concern and universe of discourse is problem solving in a 
blocks world. 

General design characteristics: 

The program is neterar cni cal iy organized. Its 

knowled^^e is comprised of those types required for abstra':'t 
general problem solving, linguistic processing, and 
reasoning* in the specific domain of discourse. The -:'omcined 
store of knowledge is represented procedv.raily, du“ in part 
to the use of micro-PLANNFH as the i>rifrary lana-ua^e of 
implementation . 

The heterarcny of the system is expressed witn thr-^e 
major pro£rrams each written in a different lan.-naa-e. The 
deduction program, written in mic^o-?IA^i'JS?., nas its own 
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oody of knowled^'s re.^ardins the specific universe of 
discourse chosen. It solves proolens of various 'cinds in the 



course cf 


exploring 


the 


consequences of 


facts 


> 


resented , 


planning 


actions , 


and 


answering questio 


ns . 


The 


semant i c 


program , 


written in 


LIS? 


, is actually a 


se t 


cf 


programs 



dealine with meaning (whether of *ords, word ^-’roups, or 
whole sentences). The third prc^^ram ioes grammatical 
parsing. Smcodied within it is e particular theory of 
Trglish grammar which is used to recognize the structure cf 
sentences [c] . For this, *inograd wrote a special purpose 
language called F?.0C-?J.i^'^AR . 

Accomplishments /limi tations : 

Although SHHCIU can 'converse' sensibly only atout 
pyramids and other inhabitants of the blocks world, it can 
parse sentences containing ncn-Flccks wcrds, li’'e 'e^gs, 
cake, mother, and recipe,' provided the ninimcl relevant 
semantic information (such as that mother is an animate 
noun' is included with tne definitions of the words in 
question. For instancf^, the program can parse (’^’.ncugn not 
reply to) the sentence, ’ Kow many e?ss would you have been 
going to use in the cake if you nadn 't learned your mother's 
recipe was wrong? [5j". 
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14:. /43STRIPS 

H. likes, i\ . Mlsson, P. Rapnael , 

X. Garvey, P. Adldinter, J . i''’unson/ 

X. Sacerdoti 

Stanford Research Institute 

I 

1971/1974: 

CLISP, INTXP.LIS? 

Junctional description: 

STRIPS is used to formulate plans (i.e., a series of 
actions that togetner establisn preconditions necessary for 
the final action'i for the robot SFASRY, w’^ich spends most of 
its time in a world consisting of 7 rooms variously 
connected by £ doors and containing several lar^^e boxes to 
be pushed from one place to another [5j . 

APS TRIPS (Abs tract on-based STRIPS) is a modification or 
improvement on STRIPS. Preconditions necessary for the 
attainment of s-oals or subgoals are ordered by -'ri ti^ality. 
This insures that the most critical preconditions are 
satisfied first. Planning is done therefore in a bierarcby 
of abstraction spaces [46] . 

General desi/?n characteristics: 

STRIPS searcnes a space of 'world models' tc find on® in 
which a given ^^oal is achieved. Each world model includes a 
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large nun ter of facts end relations dealing witn tne 
position of the robot and the attributes of various objects, 
open spaces, and boundaries. It is represented by a set of 
well-formed formulas (wffs) of the first order predicate 
calculus [ 2 £] . The problem space is composed of three 
entities : 

1. Initial world model — a set of wffs describing 
the present state of the world. 

2. A set of operators — including a description of 
their effects and precondition wff schemata. 

3. A goal condition stated as a wff — the problem 
is solved when STRIPS produces a world model 
that satisfies the goal wff. 

For searching the space of world models, STRIPS uses a 
dPS-like means-ends analysis strategy. The combination of 
means-ends analysis and formal theorem provin-=‘ methods 
allows objects (world models) to be mucn more cc'-plex and 
o'eneral than any of those used in GPS. It also provides more 
powerful search heuristics than any of those found in 
theorem proving programs [RCj . 
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Acco[r,pli5h.ments/Lin!itdtiors: 

STRIPS is atle to solve a variety of pro’olerrs of tiae 
following nature: 

1. Turn on a ligntswitcn (rnust climb on a box first — 
must find a box before that). 

2. Push three boxes togetner. 

3. Go to a location in another room [20], 



15. TALE-SPIN 

J. Meehan 
lie, Irvine 
1977 

INTERLISP 



Functional description 

TALE-SPIN is a program that generates stories !?/■ OK'ing 
diverse sources of k:nowledge including English, physical 
space, problem-solving, story structure, social 
relationships, and bodily needs. The purpose of the work is 
to test the combination and interaction of many sources of 
knowledge [ol] . 
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General design characteristics: 



TAL2-S?Pi is a, tcp-down, goal-oriented pro tlen-s o Ive r . 
Its output rnay be regarded as a trace through problem 
solving procedures [31]. It nay be viexed as a program that 
simulates rational behavior by characters in the world. It 
is composed o f three parts: a problem solver, an assertion 
mechanism (adds events to memory), and an inference 
mecnanism (produces consequences of an event). 

TAL3-SFIN draws on frame-oriented knowledge To direct 
story development. The user may initially specify the 
characters, environment, and a problem for each character to 
solve, or may specify a moral and the system generates the 
problems. Sach character in a story has a goal stack 
associated with it. An example of a goal is 'hunger' which 
possesses a set of rules sucn as, 'If you are hungry and see 
some food, you'll want to eat it,' and 'If you are trying to 
get some food and you fail, you will get sick.' Achievement 
of the goals developes the story. 

Problems are associated with an area of knowledge, i.e., 
the problem domain. This is defined by set of 
representational primitives, a set of goal states or 
problems expressed in terms of those primitives, and 
procedures for solving those problems [31j. 
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Accorrpl ishrripn t s /Lini ta t i ons : 



A san’ple story generated TALE-SFIN; 



Once upon a time Geors-e Ant lived near a patch of 
around. There was a nest in an ash tree. Wilma 
Bird lived in the nest. There was som.e water in a 
river. Wilma knew that the water was in tne river. 
George knew that the water was in the river. Ore 
day Wilma was very thirsty, ’'^il^'a wanted to aet 
near some water, Wilma flew from her nest across a 
meadow througn a valley to the river. Wilma dran^ 
the water. Wilma wasn't thirsty any more. 

George was very thirsty. George wanted to get near 
some water. George walked from his patch of ground 
across the meadow th rouah a valley to a river 
hank. George fell into the water. George wanted to 
get near the valley. George couldn't get near the 
valley. Geors'e wanted to ?et near the meadow. 
George couldn't get near the meadow. Wilma wanted 
George to get near tne meadow. Wilma wanted to get 
near Georme. Wilma mrabhed Geor^re with her claw. 
Wilma took George from the river througn tne 
valley to the meadow. George was devoted to V/ilma. 
Georc'e owed everythin^ to ’iilma. Wilma let s'C of 
George. George fell to the meadow. The end 
[reprinted from 31]. 
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